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FIRST ORDER MEAN FIELD GAMES WITH DENSITY CONSTRAINTS: 

PRESSURE EQUALS PRICE 

PIERRE CARDALIAGUET, ALPAR R. MESZAROS, AND FILIPPO SANTAMBROGIO 


Abstract. In this paper we study Mean Field Game systems under density constraints as optimality 
conditions of two optimization problems in duality. A weak solution of the system contains an extra 
term, an additional price imposed on the saturated zones. We show that this price corresponds to the 
pressure field from the models of incompressible Euler’s equations a la Brenier. By this observation 
we manage to obtain a minimal regularity, which allows to write optimality conditions at the level of 
single agent trajectories and to define a weak notion of Nash equilibrium for our model. 

1. Introduction 

1.1. The MFG system. Introduced by Lasry-Lions [22, 23, 24] (see also Huang-Malhame-Caines 
[21]) the mean field game system (in short, MFG system) describes a differential game with infinitely 
many identical players who interact through their repartition density. The first order MFG system 
with a local coupling takes the form 

( (i) — dtu + H(x,Du ) = f(x,m) in(0,T)xT d 

< (ii) dtm — div (mD p H(x, Du)) = 0 in(0,T)xT d (1.1) 

[ (iii) u(T,x) = g(x), m(0,x) = mo(x) in T d . 

Here, to avoid the discussion of the boundary data, we work for simplicity with periodic boundary 
conditions, i.e., in the torus T d := M d /Z d . Since the main accent in this paper will be on the modeling 
of the density constraint, we keep this simpler setting. Let us remark that without much effort, with 
the same ideas it is possible to treat the case of general domains with the corresponding boundary 
conditions. The Hamiltonian H : T rf x —> R is typically convex with respect to the last variable and 
the coupling cost / : T d x [0, +oo) is nondecreasing with respect to the last variable. The monotonicity 
of the coupling formalizes the idea that the players dislike congested areas. It will be highly exploited 
later in the variational setting, which will imply in particular a convexity property for the energy 
functional. Moreover all these assumptions are typical in the general MFG theory. 

Let us briefly describe the interpretation of (1.1). In the above backward-forward system, u = u(t, x) 
is the value function associated to any tiny player while m = m(t, x ) is the density of the players at 
time t and at position x. The value function u(t, x) is formally given by 

u{t, x) = inf [ L(j(s), 7 (s)) + /(y(s), m(s, y(s)) ds + gin{T)) 

T' Jt 

where the player minimizes over the paths 7 : [t,T] —>• T d with 7 (f) = x, f = f(x,m(t,x )) is the 
running cost, L is obtained from the Fenchel conjugate of H with respect to the last variable, and 
g : T rf —>• M is the terminal cost at the terminal time t = T. The running cost / couples the two 
equations and acts as a penalization for those regions where the density m is too high. 

At the initial time t = 0, the initial distribution is m 0 (a probability measure on T d ). Then the 
density evolves according to the motion of the players. Since - by standard argument in optimal 
control - it is optimal for the players to play 7 (s) = — D p H('y(s), Du(s,^(s)), the evolution of the 
density is given by the continuity equation (l.l)-(ii). 
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Note that each tiny player acts as if he/she knew the evolution of the players’ density m = m(t,x ) 
(he/she somehow “forecasts” it, as usually in a “rational expectations” framework). Actually he/she 
needs this forecast in order to solve his/her individual control problems. Solving this problem he/she 
obtains the value function u and the optimal velocity field -D p H(-, Du). Then the “true” evolution 
of the players’ density is given as the transport of the initial density by this field (this corresponds to 
the continuity equation in system (1.1)). 

The mean field game system corresponds to an equilibrium situation where the “forecast” of the 
players is correct: the solution of the continuity equation is indeed m = m(t , x), which was the forecast 
made by the players. In terms of game theory, this corresponds to a Nash equilibrium. 

Existence and uniqueness of solutions for the above problem are discussed by P.-L. Lions in [25] 
(through a reduction to an elliptic equation in time-space when the coefficients are smooth, under 
the additional assumption lim m _>.o /(x, m) = — oo, which is satisfied for instance for log-like couplings, 
which guarantees m > 0 and hence ellipticity) and in Cardaliaguet [11], Graber [20], Cardaliaguet- 
Graber [13], Cardaliaguet-Porretta-Tonon [15] (following an approach by variational methods sug¬ 
gested in [24] and also inspired by Benamou-Brenier [4]). Recently, in [5] Benamou and Carlier used 
similar variational techniques to study an augmented Lagrangian scheme for MFG problems and obtain 
efficient numerical simulations. 


1.2. The problem with a density constraint. In this paper we study the behavior of the MFG 
system when there is a density constraint, i.e., when the density m cannot exceed some given value 
rri > 1 / |Tr c/ 1 = 1. Namely: 0 < m(t,x ) < m at any point (t, x). In other words, the players pay an 
infinite price when the density goes above rri: f(x,m ) = +oo if m > rri. The question of how to 
model this situation was first introduced by Santambrogio [28] and then investigated Meszaros and 
Silva in [27] in the framework of stationary second order models. We emphasize the fact that imposing 
a density constraint will result in a so-called “hard congestion” effect in the model. Models of MFGs 
where so-called “soft congestion” (meaning that agents slow down when they reach zones with high 
density) effects have been studied recently by Gomes and Mitake in [18], by Gomes and Voskanyan in 
[19] and by Burger, Di Francesco, Markowich and Wolfram in [10]. 

Coming back to our model, there are several issues in the interpretation of system (1.1) when 
there is a density constraints. Indeed, the above interpretation does not make sense anymore for the 
following reason: if, on the one hand, the constraint rri < rri is fulfilled, then the minimization problem 
of the agents (due to the fact that they are considered negligible against the others) does not see this 
constraint and the pair (u, m) is the solution of a standard MFG system; but this solution has no 
reason to satisfy the constraint, and there is a contradiction. On the other hand, if there are places 
where m(t, x) > rri, then the players do not go through these places because their cost is infinite 
there: but then the density at such places is zero, and there is again a contradiction. So, in order to 
understand the MFG system with a density constraint, one has to change the point of view. We shall 
see that there are several ways to understand more deeply the phenomena behind this question. We 
warn the reader that the model that we will obtain significantly differs from that in [28]. 

Perhaps the simplest approach is to go through an approximation argument: let us consider the 
solution {u £ , m £ ) corresponding to a running cost f £ which is finite everywhere, but tends to infinity 
as e tends to 0 when m > rri. In orther words, f £ (x,m ) —>• f{x,m) if m <m and f(x,m) —> +oo if 
m > rri, as £ -> 0. In this case the MFG system with a density constraint should simply be the limit 
configuration (a limit which should be proven to be well-defined). 

We indeed show that the pair ( u £ ,m £ ) has (up to subsequences) a limit ( u,m ) which satisfies (in a 
weak sense) the following system: 


(i) —dtu(t,x) + H(x,Du(t,x)) 

(ii) dtm{t , x) — div ( mD p H(x , Du(t, x))) 

(hi) u(T, x) = g(x) + /3 T (x), 

(iv) 0 < m(t, x) <m 


= f(x,m(t,x)) + /3(t,x) in (0, T) x T d 
= 0 in (0, T) x T d 

m( 0, x) = mo(x) in T d 

in [0, T] x T d 


( 1 . 2 ) 
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Besides the expected density constraint (iv), two extra terms appear: /3 in (i) and (3t in (iii). These 
two quantities turn out to be nonnegative and concentrated on the set {m = m}. They formally 
correspond to an extra price payed by the players to go through zones where the concentration is 
saturated, i.e., where m = m (in traffic language, this would be a toll). In other words, the new 
optimal control problem for the players is now (formally) 

u(t,x)= inf f L( 7 (s), 7 (s))+ /( 7 (s),m(s, 7 (s))+/ 3 (s, 7 (s))ds + 5 ( 7 (T))+/ 3 t ( 7 (T)), ( 1 . 3 ) 

7 (t)=x * 


and thus (still formally) satisfies the dynamic programming principle: for any 0 < ti < t 2 < T, 

/ h 

L(j(s),'y(s)) + f(j(s),?n(s,'y(s)) + fi(s, y(s)) ds + u(t 2 , 7 (^ 2 ))- (1.4) 

y(ti)=x 1 


The “extra prices” /3 and (3t discourage too many players to be attracted by the area where the 
constraint is saturated, thus ensuring the density constraints (iv) to be fulfilled. The reader familiar 
with theoretical economics can realize immediately that this is exactly the typical role of prices: a 
price is a quantity determined by a global configuration, which replaces, in the individual choices of 
the agents, the presence of the constraint. 


1.3. The variational method. Another way to see the problem is the following: it is known (see 
[24]) that the solution ( u,m ) to (1.1) can be obtained by variational methods at least when / is finite 
everywhere. More precisely, the value function u is (formally) given as a minimizer of the functional 

A(u) := f I F*(x,—dtu + H(x,Du))dxdt— f u(0,x) dmo(x), 

Jo J T d J T d 

subject to the constraint that u(T,x) = g(x), where F = F(x,m) is an antiderivative of / = f(x,m ) 
with respect to m and F* is its Legendre-Fenchel conjugate w.r.t. the second variable. In the same 
way m is (formally) given as a minimizer of the problem 

B(m,w) := [ g(x)m(T, x) dx + f f m(t,x)H* (x, ——) + F(x,m(t,x)) dxdt 

./Yd ./Yd V 771/ 


subject to the constraint 


dtm + div(u;) = 0 in (0, T ) x T d , m(0) = mg, 


where H* is the convex conjugate of H with respect to the last variable. With the language of the 
theory of optimal control of PDEs, the additional variable w : [0, T] x T d —7 plays the role of the 
control, while m can be seen as the state variable. 

It turns out that both problems make perfectly sense, even when f(x, m) = +00 if m > m. In 
fact, if f £ is a finite approximation of / as before, one can expect the minimizers of A £ and B £ 
(corresponding to f £ ) to converge to the minimizers of A and B as e —> 0 (as a simple consequence of 
T—convergence). This is precisely what happens. Note that, as f(x,m ) = +00 for m > rn, F(x,m) 
has the same property, so that F*(x,m) is linear on [m, + 00 ). This linear behavior explains the 
appearance of the terms f3 and (3t described above. 


1.4. Connections between MFGs with density constraints and the incompressible Euler’s 
equations a la Brenier. It is not surprising, due to the constraint m < m, that some strong 
connections between our model and the variational models for the incompressible Euler’s equations 
studied by Brenier (see [7]) and also by Ambrosio and Figalli (see [2]) arise. What was unexpected 
at the beginning of our study is the role that this connection would play in regularity. In order to 
understand the analogy, notice that the incompressibility constraint in the model of Brenier to study 
perfect fluids is what introduces the pressure field. Morally the same effect happens imposing density 
constraint for MFG. Using the common variational structure, similar also to the one introduced by 


4 


P. CARDALIAGUET, A.R. MESZAROS, AND F. SANTAMBROGIO 


Benamou and Brenier in [4], shared by the incompressible Euler equation and by our model, we can 
easily interpret the terms (3 and fix, that we call “additional prices/costs” for the agents (appearing 
only if they pass through saturated zones) in ( 1 . 2 ) as a sort of pressure field from fluid mechanics. 
This observation motivates the title of our work as well. 

Using similar techniques as in [7] and [2, 3] we show that (3 is an 

Ll c ((0,T)-BV(T d )) ^ Lf o / c (d - 1 ) ((0,T) x T d ) 

function (while a priori it was only supposed to be a measure) and fix is L l { T d ). With the help of 
an example we show that this local integrability cannot be extended so as to include the final time 
t = T, which shows that the result is somehow sharp. This regularity property will allow us to give 
a clearer (weak) meaning to the control problem (1.4), obtaining optimality conditions along single 
agent trajectories. Our techniques to proceed with the analysis rely on the properties of measures 
defined on paths, that we shall call density-constrained flows in our context, and we are exploiting 
some properties of a Hardy-Littlewood type maximal functional as well (this is very much inspired by 

I 2 ])- 

After this analysis we deduce the existence of a local weak Nash equilibrium for our model. 

The paper is organized in the following way. We first introduce our main notation and assumptions 
(Section 2 ). Then we discuss the two optimization problems for A and B described above (Section 3). 
We introduce the definition of the MFG system with a density constraint, present our main existence 
result as well as the approximation by standard MFG systems in Section 4. In Section 5, by means 
of an example, we study some finer properties of a solution (m, u, (3 , fix) °f the MFG system with 
density constraints. Section 6 is devoted to the proof of the L d ^ d ^ integrability of the additional 
price f3 under some additional assumptions on the Hamiltonian and the coupling. Finally, having in 
hand this integrability property, we introduce in Section 7 the optimal density-constrained flows and 
derive optimality conditions along single agent paths, which allow in particular to study the existence 
of the local weak Nash equilibrium. 

Acknowledgement: The first author was partially supported by the ANR (Agence Nationale de la 
Recherche) projects ANR-10-BLAN 0112, ANR-12-BS01-0008-01 and ANR-14-ACHN-0030-01. The 
second and third authors were partly supported by the ANR project ANR-12-MONU-0013 and by the 
iCODE project “strategic crowds” of the IDEX Universite Paris-Saclay. 

2. Notations, assumptions and preliminaries 

We consider the MFG system with a density constraint (1.2) under the assumption that all the 
maps are periodic in space. Typical conditions are 

(HI) The density constraint m is larger than 1 = 1/|T“|. 

(H2) (Conditions on the initial and final conditions) mo is a probability measure on T fi which is 
absolutely continuous with respect to Lebesgue measure and there exists c > 0 such that 
0 < mo < m — c a.e. on T d . We assume that g : T d —> R is a C 1 function on T d . 

(H3) (Conditions on the Hamiltonian) H : T d x M d —> R is continuous in both variables, convex and 
differentiable in the second variable, with D p H continuous in both variables. Moreover, H has 
superlinear growth in the gradient variable: there exist r > 1 and C > 0 such that 

-4bl r ~C< H(x,p) < -\p\ r + C. (2.1) 

rL r 

We denote by H*(x, •) the Fenchel conjugate of H(x, •), which, due to the above assumptions, 
satisfies 

±-\q\r' -C<H*(x,q)<%\ r ' +C, 

T O V 


( 2 . 2 ) 
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where r' is the conjugate of r. We will also denote by L the Lagrangian given by L(x,q) = 
H*(x, —q), which thus satisfies the same bounds as H*. 

(H4) (Conditions on the coupling) Let / be continuous on x [0, m], non-decreasing in the second 
variable with f(x, 0 ) = 0 . 

Let us comment now on the previous assumptions. (HI) and (H2) are assumptions on the initial 
and final conditions, since m o is a probability measure on T d , because of the mass-conservation mt 
will be also a probability measure on T d for all t € [0, T\. The density constraint should satisfy m > 1, 
otherwise imposing that a probability measure m < m on T d would give either a trivial competitor 
or no competitor at all. It is natural to impose 0 < mo < m, i.e. we start with an initial distribution 
that already satisfies the constraint. The modified upper bound m <m — c for some c > 0 small real 
number is just a technical assumption that we need in the analysis. Assumptions (H3) and (H4) 
are natural growth and structural conditions that are typical while working with variational MFG 
systems. In particular imposing that / is non-decreasing will imply that the energy functional B is 
convex. 

We define F so that F(x,-) is an antiderivative of /(x, •) on [0,m], that is, 

rm 

F(x,m) = / f(x,s)ds, Vm€[0,m], (2.3) 

Jo 

and extend F to +oo on (—oo, 0) x (m, +oo). It follows that F is continuous on T rf x [0, m], is convex 
and differentiable in the second variable. We also define F*(x, •) to be the Fenchel conjugate of F{x , •) 
for each x. Note that 

F*(x, a) > am — F{x 1 m) (2.4) 

and F*(-,a ) = 0 for all a < 0. Following the approach of Cardaliaguet-Carlier-Nazaret [12] (see also 
Cardaliaguet [11], Graber [20] or Cardaliaguet-Graber [13]) it seems that the solution to (1.2) can be 
obtained as the system of optimality conditions for optimal control problems. 

2.1. Optimal transport toolbox. In this subsection we collect some basic notions and results from 
the theory of optimal transportation which we will need in the sequel. We refer to [29, 30] general 
references to this theory. Let 12 C be a compact subset (or any compact subset of a Polish space). 
Even if in the whole paper we will restrict ourselves to the case of 12 = T rf , we state the following 
results in the general case. Given two probability measures p, v £ "P(I2) and for p > 1 we define the 
usual Wasserstein metric by means of the Monge-Kantorovich optimal transportation problem 

W p (p, u) ■.= inf <j / \x-y\ p dy^y) : 76 ^/ 1 ,!/) ”, 

I J flxfl J 

where := {7 € V(£l x 12 ) : (- n x )^ = /i, ( 7 r y )#7 = v} and 7 t x and ir y denote the canonical 

projections from 12 x 12 onto 12 (in a more general setting, 12 being any compact subset of a Polish 
space, in the definition of W p one has to replace the Euclidean distance \x — y\ by the distance induced 
by the underlining metric d). This quantity happens to be a distance on - P(I2) which metrizes the 
weak-* convergence of probability measures; we denote by W p (I2) the space of probabilities on 12 
endowed with this distance. 

Historically, the quadratic case p = 2 had been understood first. So, let us state the most fundamen¬ 
tal results in this case. Under the additional assumption p <C £ rf Lf2 (p is absolutely continuous w.r.t. 
the d —dimensional Lebesgue measure restricted to 12) Brenier showed (see [ 8 , 9]) that the optimal 7 
in the above problem is actually induced by a map, which turns out to be the gradient of a convex 
function, i.e. there exists T : 12 —> 12 and ^ : f2 —> M convex such that T = and 7 := (id, The 

function if) is obtained as i/j(x) = A|cc | 2 — p{x), where ip is the so-called Kantorovich potential for the 
transport from p to is, and is characterized as the solution of a dual problem. In this way, the optimal 
transport map T can also be written as T(x) = x — X7(p(x). Later, McCann (see [26]) introduced a 
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useful notion of interpolation between probability measures: the curve pt '■= ((1 — t)x + ty)jj. 7 , for 
t £ [0,1], gives a constant speed geodesic in the Wasserstein space connecting po := P and pi := v. 

Based on this notion of interpolation, Benamou and Brenier using also some ideas from fluid me¬ 
chanics, gave a dynamical formulation to the Monge-Kantorovich problem (see [4]). They showed 
that 

-W£(p, v) = inf { B p (E t ,p t ) : d t pt + di v(E t ) = 0, p 0 = p, pi = u}, 

p 1 


where B p : 97t([0,1] x Q) d x L°°([0,l];W p (fl)) ->tU {+ 00} 1 is given by 


B p (E,p) := 


H 1 - 

Jo ./n P 

+ 00 , 


d E 


dp 


d pt{x) df, if E <C Pi 
otherwise. 


It is well-known that B p is jointly convex and l.s.c. w.r.t the weak-* convergence of measures (see 
Section 5.3.1 in [29]) and that, if dtpt + di v(Et) = 0, then B P (E, p) < +00 implies that t p t is a 
continuous curve, belonging to TY 1 ,p ([0,1]; W P (I2)). In particular pt is well defined for all t £ [0,1]. 

We shall use the notion of narrow convergence in V(Ll), which is the weak-* convergence in duality 
with continuous and bounded functions on Q. Since in our case II is compact, then V{ii) is also 
compact for this convergence. 


2.2. Measures on curves and a superposition principle. Let us denote by T the set of absolutely 
continuous curves 7 : [0,T] —» T d . We denote by V(T) the set of Borel probability measures defined 
on T. Let us set V r (T) {r > 1) to be the subset of V{T) such that 

| 7 (s)| r dsd? 7 ( 7 ) < + 00 . 

Note that the space T, which is naturally endowed with the uniform convergence topology, is not 
compact, and hence 'P(r) is not compact for the narrow convergence. Yet, Prokhorov Theorem 
guarantees that any family of probability measures on a Polish space II is relatively sequentially 
compact w.r.t. the narrow convergence provided it is tight. Tight means that for any e > 0 there 

exists a compact set K C fl such that for any p from this family p(VL \ K ) < e. In the case of ’P(T), 

r r T 



it is easy to see that a uniform bound on l 7 ( s )| r dsd^y) is enough to provide tightness. This 

Jr Jo 

will be useful later in the paper. 

We also define the evaluation maps et : T —> T rf , given by et(y) := 7 (t) for all t £ [0,T]. This allows 
to state a well-known result, a connection between the solutions of the continuity equation and the 
measures on paths, called superposition principle, which can be considered as a weaker version of the 
DiPerna-Lions-Ambrosio theory (see for instance Theorem 8.2.1. from [1]). 


Theorem 2.1. Let p : [0, T] P(T d ) be a narrowly continuous solution of the continuity equation 
dtp + d\v(vp) = 0, po £ V‘ 2 (^ d ) for a velocity field, v : (0, T) x T d -A M. d satisfying / / |ut| 2 d//tdf< 

Jo Jf d 

+ 00 . Then there exists rj £ V(T) such that 

(i) p t = (e t )#r) for all t £ [0,T]; 

(ii) we have the energy inequality 

Irlo ^^ 2<itdri ^ ~ 

(iii) 7 (t) = vti'yit)), forrj—a.e. 7 and a.e. t £ [0,T] 


1 0 J T d 


|u | 2 dpt di; 


^We denote by £Ut(X) the signed Radon measures on X. Observe that fi G L°°([0,1]; W p (f2)) only means that n = [pt)t 
is a time-dependent family of probability measures. 
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3. Optimal control problems 


We look in this section at two PDE control problems that will lead to our Mean Field Game model. 
The first one is an optimal control problem of Hamilton-Jacobi equations: denote by K.p the set of 
functions u £ C' 1 ([0, T] x T rf ) such that u{T,x) = g(x ) (the subscript P stands for “primal”). Let us 
define on Kp the functional 

A(u) = f I F*(x, — dtu + H(x, Du)) dxdt — f ri(0, x) dm.o(x). (3-1) 

Jo J T d J T d 

Then we have our first optimal control problem. 

Problem 3.1 (Optimal control of HJ). Find inf A(u). 

u(JzK,p 

It is easy to check that one can restrict the optimization to the class of minimizers such that 

—dtu + H(x, Du) > 0, because F*(x, a) = 0 for a < 0 (see Lemma 3.2 in [11]). 

The second problem is an optimal control problem for the continuity equation: define JCd to be 
the set of all pairs ( m,w ) € L 1 ([0,T] x T rf ) x L 1 ([0,T] x T d ;M rf ) such that m> 0 almost everywhere, 

/ m(t,x) dx = 1 for a.e. t £ [0, T] (the subscript D stands for “dual”), and 

J T d 

d t m + div(rc) = 0 in (0, T) x T 0 ' 

m(0, •) = mo in T'l 

in the sense of distributions. Because of the integrability assumption on w, it follows that t e-?• m(t) 
has a unique narrowly continuous representative (cf. [1]). It is to this representative that we refer 
when we write m(t), and thus m(t) is well-defined as a probability density for all t £ [0,T], 

Define the functional 

B(m,w) = [ g(x)m(T, x) dx + [ [ m(t,x)L (x, \ + Fix, m(t, x)) dxdt (3.2) 

Jid, Jo Jfd V m(t,x)J 

on K.£). Recall that L is defined just after (2.2). We follow the convention that 

w 


mL x 


m■ 


(3.3) 


Too, if m = 0 and w ^ 0, 

0, if m = 0 and w = 0. 

Since m > 0, the second integral in (3.2) is well-defined in (—oo, oo] by the assumptions on F and 
L. The first integral is well-defined and necessarily finite by the continuity of g and the fact that 
m(T, x) dx is a probability measure. 

We next state the “dual problem” as 


Problem 3.2 (Dual Problem). Find inf 

( m,w)£K.n 


Proposition 3.3. Problems 3.1 and 3.2 are in duality, i.e. 

inf A(u) = — min B(m, w) (3-4) 

uGlCp (m,w)GK.D 

Moreover, the minimum on the right-hand side is achieved by a pair (m, w) £ K-d with m £ L°°([0, T] x 
T d ) and w £ L r '([0,T] x T d ;M d ). 

Proof. The proof relies on the Fenchel-Rockafellar duality theorem (see for example [17]) and basically 
follows the lines of the proof of Lemma 2.1 from [11], hence we omit it. The integrability of ( m,w ) is 
just coming from the density constraint and from the growth condition of H*. □ 

Remark 3.4. If f is strictly increasing with respect to the second variable in x (0,m), then the 
minimizer (m, w) is unique. 
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In general one cannot expect Problem 3.1 to have a solution. This motivates us to relax it and 
search for solutions in a larger class. For this let us first state the following observation. 


Lemma 3.5. Let (u n ) be a minimizing sequence for Problem 3.1 and set a n = —dtu n + Pt(x, Du n ). 
Then (u n ) is bounded in BV([0, T] xT rf )nL r ([0, T] xT rf ), the sequence ( a n ) is bounded in L 1 ([0,T]xT d ), 
with a n > 0 a.e., while ( Du n ) is bounded in L r ([ 0, T] xT d )- Finally, there exists a Lipschitz continuous 
function if : [0, T] x T d — > R such that ip(T, •) = g and u n > ip f or any n. 

Proof. As F*(-,a ) = 0 for a < 0, we can assume without loss of generality that a n > 0 (indeed, if 
we replace a n with its positive part, the part with F* does not increase, and the value of u n {0,x) 
does not decrease, by the maximum principle applied to the HJ equation connecting u n to a n ). By 
comparison, u n > ip where i /> is the unique Lipschitz continuous viscosity solution to 

— dtip + H(x,Dip ) = 0 in(0,T)xT d 
ip(T,x) = g(x) in T d . 

So (u n ) is uniformly bounded from below. Integrating the equation for (u n ) on [0, T] X T d and using 
the fact that Ft > —C and the fact that g is bounded, we get (up to redefining the constant C > 0) 

u n (0,x)dx< / / a n dxdt + C. 

Jo JT d 


J T d 

So, by (2.4) and for n large enough, 
inf ue K p A{u) + 1 > 
> 

> 


/ o m Jf d 


F*(x,a n )dxdt — / u n (0,x)modx 


!T d 


IT d 


ma n dxdt— / u n (0, x)m 0 dx — C 

Jf d 


/ T d 


u n { 0, x)(m — mo) dx — C. 


By (H2) m — mo > c: as we know that u n ( 0, •) is bounded from below, we get that (u n ( 0, •)) is 
bounded in L 1 ( T d ). Thus, as a n > 0, we also have that (a n ) is bounded in L 1 ([0, T] x T d ). Then 
integrating the equation a n = —dtu n + H(x,Du n ) over [t,T] x T d and using the lower bound on H , 
we get on the one hand 


lj d 


u n (t, x) dx < 


/7 

Jt Ji d 


a n dx d t + C, 


which, in view of the lower bound on u n , gives an L°°([0,T]) bound on (u n (t,-)) = / u n (t, x) dx. 

J T d 

We integrate again the equation a n = —dtu n + H{x,Du n ) over [0, T] x and use the coercivity of 
H and Poincare’s inequality to get 

C > f f andxdt + C > f f H{x,Du n )dxdt > (1/C) f f \Du n \ r dxdt — C 
Jo J T d Jo j T d Jo Jt 1 

>(1/C) f f \u n — (u n (t, •))| r dx dt — C > (1/C) f f \u n \' dx dt — C. 

Jo Jj d Jo J T d 

In particular ( Du n ) and (u n ) are bounded in L r ([0,T] x T d ). Thus dtu n = — a n + H(x,Du n ) is 
bounded in L 1 ([0,T] x T rf ). The result follows. □ 


By the results of Lemma 3.5 we introduce a relaxation of the Problem 3.1. Let us denote by /Cr 
( here the subscript R stands for “relaxed”) the set of pairs (u,a) such that u € BV([0,T] x T d ) with 
Du E L r ([0, T] x T''*;!^) and u(T~ , •) > g a.e., a is a nonnegative measure on [0, T] x T d , and, if we 
extend (it, a) by setting u = g and a := Ft (•, Dg ) dx dt on (T, T + 1) x T rf , then the pair (it, a) satisfies 

—dtu + Ft (x, Du) < a 
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in the sense of distribution in (0, T + 1) x T d . Note that the extension of (u, a) to [0, T + 1] x T d just 
expresses the fact that u(T + ) = g and that a compensates the possible jump from u(T~) to g. We 
set 

A(u,a) = I I F*(x, a ac (t,x)) dx dt+ ma s ([0,T] x T 
Jo J T d 

where a ac and a s are respectively the absolutely continuous part and the singular part of the measure 

a. 



Problem 3.6 (Relaxed Problem). Find inf A(u,a). 

(u,a)eK R 


Let us consider the following result as a counterpart of Lemma 2.7 from [13] in our case. 

Lemma 3.7. Let ( m,w ) £ /C d such that m £ L°°([0,T] xT d ) and ( u,a ) £ KLr an arbitrary competitor 
for Problem 3.6. Then, for every t £ [0. T], we have 

rt 


and 


If 

Jo Ji d 


n 

Jt J T d 


W 


m 


—mH* (a:,-) dx dt < / m 


lT d 


+ 


i(t,x)u(t , x)dx — / mo(x)u(0 + , x) dx 

Jr d 

f f a ac mdx dt+ ma s ([0,t] xT d ) 

Jo Jf d 


-mH* x , - 


s,-) dxdt< / m(T, x)g(x) dx — / m{t,x)u{t + ,x) dx 

m J J-fd. Jf d 

+ / a ac mdxdt+ ma s ([t,T] xT d ). 

Jt J T d 


Moreover we can take t = 0 in the above inequalities. If, finally, equality holds in the second inequality 
when t = 0, then w = — mD p H{-,Du ) a.e. and 


limsupm e (t, x) = m for a s — a.e. (t,x) £ [0, T] x T d , 

£—>-0 

where m £ is any standard mollification of m. 

Proof. We prove the result only for t = 0, the general case follows by a similar (and simpler) argument. 
We first extend the pairs (u, a) and (m, w ) to (0, T +1) x by setting u = g and a := H(-, Dg) dx dt, 
m(s,x ) = m(T,x), w(s,x) = 0 on (T, T + 1) x T^. Note that 

dtm + div(tu) = 0 and — dtu + H(x, Du) < a on (0, T + 1) x T d . 

We smoothen the pair (m, w ) in a standard way into (■ m £ ,w £ ): m e := m * p e and w £ := w * p E , where 
the modifier p has a support in the unit ball of and p £ := p{-/e). Then, for any rj > e, we 

have, since m £ < m, 


rT+iq r 

/ / udtm £ + m e H{x,Du) dxdt— 

Jn Jj d 


1 T+r) 


m F u dx 


< 


Jr d J 7j+ 

rT+ri p rT+r] r 

/ m £ da< / a ac m £ dx dt+ ma s ([r],T + r/\ x T d ) 

J 71 JT d J 71 JT d 


(3.5) 


where, as dtm £ + div(u; £ ) = 0, 

rT+iq 


r‘ +r/ r 

/ / 

Jr ? Jl d 


udtm £ dx dt = 


f T+v [ 

Jn Jf d 


Du ■ w £ dx dt. 
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In the followings, we shall consider only such r/’s for which no jump of u occurs, in particular 

/ u(rj- ,x) dx = / u(r] + ,x) dx = / u(rj, x) da™. So, by convexity of H, (3.5) and the above equality, 
J T d -h d JT d 

rT+r) 


I'T+ri r 

Jn J T d 


-m e H* x, - 


w e 


< 


m £ 

T+r) 


\ r T +v r 

) dxdt < / w £ ■ Du + m e H(x, Du) dx dt 

J Jr) J T d 


m F udx 


Ijd 


rT+r) 


+ 


Ijd 


a ac m £ dx dt + ma s ( [rj, T + rj\ x T d ). 


We multiply the inequality —dtu + H(x,Du) < a by m £ (r), •) and integrate on (0, 77 ) x T d to get, as 
m £ is bounded by m and H is bounded from below, 


[ 

JT d 


u(0 + , x)m £ (r], x) dx < / 11 ( 77 , x)m £ (rj, x) dx + Crj + ma((0, 77 ) x T rf ). 


Ij d 


Note that ma((0,t|) x T rf ) = ma s ([0,?j) x T d ) + o(l), where o(l) —>■ 0 as 77 —>■ 0. So 

rT+r/ 


—m e H x, - 


w F 


m f 


dx dt < 


rl +ri r 

Jr) Jl d 

< / [m £ (T + 77 , x)u(T + 7 ], x) — it(0 + , x)m £ (r], x)] dx 
Td T+ 

+ / a ac m e dxdt + ma s ([0, T + 77] x T d ) + o(l). 

Jr) J T d 

We now let e —0. By convergence of ( m £ ,w £ ) to ( m,w ) in L q x L r> , \/q > 1, and by the fact that 


rT+r) 


lim 

£—>0 


Ijd 


rT+r) r 

m £ H*(x,—w £ /m £ )dxdt= / / mH*(x, — w/m) dx dt, 

Jn j T d 


(see the proof of Lemma 2.7. from [13]) we obtain for all > 0, chosen above, 

[ +V [ —mH* (x,-—) dxdt < 

Jr) Jf d v 

< / [m(T + 77 , x)u(T + 77 , x) — u(0 + , x)m(r], x)] dx 

J T d m 

rT+r) r 

+ / / a ac mdxdt + rna s ([0,T + r/\ xT d ) + o(l). 

Jr) Jf d 

By definition of the extension of the maps u and m, 

f [m(T + r])u(T + 77 ) — u(0 + , x)m(rj, x)] dx + [ [ a ac m dx dt + ma s ([0, T + 77 ] x T d ) 

J T d Jr) J T d 

= / [m(T, x)g{x) — u(0 + , x)m(r], x)] dx + / / a ac mdxdt+ ma s ([0,T} x T d ). 

J T d Jn J T d 


We finally let r] —> 0 and get 

r-T 

— mH * ( x, — 


If 


0 J T d 
< 


W 


m 


dx dt 


lj d 


[m(T, x)g(x) — u(0 + , x)mo(x)] dx + f f a ac mdx dt + ma s ([0,T] x T d ) 

Jo J T d 


thanks to the L°°—weak-* continuity of t 1 —>• m(t) and the L 1 integrability of u( 0 + , •). 

The proof of the equality w = -mD p H(-, Du) when equality holds in the above inequality follows 
exactly the proof of the corresponding statement in [13], so we omit it. Note that, if equality holds, 
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then all the above inequalities must become equalities as e and then 77 tend to 0. In particular, from 
inequality (3.5), we must have 

limlimsup [ [ m £ (t, x) da s (t, x) = fna s ([0, T] x T d ). 

V->° £->0 Jij Jl d 

By Fatou’s lemma, this implies that 

ma s ([0, T\ x T d ) < f f lim sup m e (t, x) da s (i, x), 

Jo J T d £—>0 

where the right-hand side is also bounded above by the left-hand side since m e < m. So lim sup m £ = rri 

£—^0 

a s — a.e. □ 


Proposition 3.8. We have 

inf A(u) = min A(u,a). 

U&K.P ( u,a)£lC R 


(3.6) 


Moreover, if (u, a) is a minimum of A, then a = a L [0, T) x T d + ( u(T , •) — g) d (<5 r < 8 > Ji d L T d ). 


Proof. We follow here [20]. Inequality > is obvious and we now prove the reverse one. Let us fix 
(u, a) £ Kr and let (m, w) be an optimal solution for the dual problem. Then 

A(u,a) = [ f F*(x,a ac )dxdt+ ma s ([0,T] xT d ) — f mo(x)u(0 + , x) dx 

Jo T Jr d JT d 

/ / (ma ac — F{x,m))dxdt + ma s ([0,T] x T d ) — / ino(x)u(0 + , x) dx 

Jo J T d J T d 


> 

> 


[ [ ( 

Jo Jf d 


—mH*(x,—w/m) — F(x,m))dxdt — / m(T,x)g(x) dx = — B(m,w ) 

Jt 1 


where the last inequality comes from Lemma 3.7. By optimality of (m, w ) and (3.4) we obtain therefore 

A(u,a) > inf A(u), 

u£K.p 


which shows equality (3.6). 

To prove that the problem in the right-hand side of (3.6) has a minimum we consider a minimizing 
sequence (u n ) for Problem 3.1. We extend u n = g on (T, T + 1] x T d and set a n := —dtu n + H(x, Du n ) 
on [0, T + 1] x T d and note that, in view of Lemma 3.5, there is a subsequence, again denoted by 
(■ u n ,a n ), such that (u n ) converges in L 1 to a BV map u, ( Du n ) converges weakly in L r , and (a n ) 
converges in sense of measures to a on [0, T + 1] x T d . As u n > if on [0, T] x T d , we also have u > if 
(0,T)xT d , so that u(T , •) > ip(T, •) = g. By convexity of H with respect to p, the pair (u, a) belongs 
to /Cr. One easily shows by standard relaxation that 


A(u,a) < lim inf A(u n ). 

n—>oo 

Hence (u, a) is a minimum. 

Let us finally check that a = aL (0, T) x T d + (u(T ~, -) — g)d ( St ® Ji d L T d ). Indeed, by definition 
of Kr, we can extend (it, a) by setting (it, a) := ( g,H(-,Dg )) on (T, T + 1) x T d and the following 
inequality holds in the sense of measure in (0,T + 1) x T d : 


—dtu + H(x, Du) < a 

Let cj) £ C' 00 (T d ), with <f> 0, be a test function. We multiply the above inequality by f and integrate 
on (T — g,T + r/) x T d to get 



<f>{x)u((T — g) + ,x) dx + 


nT+ri 


iT-r, 


[ (fH{x, Du) 
J T d 


dx d t < 
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Letting 77 —> 0 along a suitable sequence such that u((T — g) + , •) —> u(T , •) in L 1 , we obtain: 

/ 4>u(T~, x) dx < / 5 (/)dx+ / <^d(aL{T} xT d ). 

,/T d ./T d ./T d 

This means that u{T ~, •) < <? + a L {T} x T rf . Let us now replace a by 

a := a L (0, T) x T d + (u(T ~, •) - g) d (<S T 0^ d L T d ) . 

We claim that the pair (it, a) still belongs to ICr. For this we just have to check that, if we extend 
(it, a) to (0, T + 1) x T d as before, then 

—dtu + H(x, Du) < a on (0, T + 1) x T d 

holds in the sense of distributions. Let (j) € C^°((0, T + 1) x T d ) with 4> > 0. Then 

f f udt(f> + (f>H (x, Du) dx d t = 

JO J T d 

= f I udt(j> + <f>H(x, Du) dx dt + f f gdt4> + 4>H(x, Dg) dx dt 
Jo JY d Jt J T d 

< f f <j>d(a L (0, T) x T d ) + f (u(T~, x) — g)<J>(T, x) dx + f f <pH(x,Dg)dxdt 

Jo J T d J T d Jt J T d 


< 


r / 

Jo j T d 


4>dd. 


This proves that the pair (it, a) belongs to Kr. In particular, A(u,a) < A(u,a), so that 

ma s ({T} x T d ) <m u(T~,x) — g{x) dx. 

Ji d 

Since we have proved that u(T~, •) < g + a L {T} x T rf , we have therefore an equality in the above 
inequality, which means that aL{I} x T (/ = (u(T ,-)~g) dx. □ 

4. The MFG system with density constraints 
In this section, we study the existence of solutions for the MFG system with density constraints: 


(4.1) 


under the assumptions on H, /, g and uiq stated in Section 2. We also study the approximation of 
the solution of this system by the solution of the classical MFG system. 

4.1. Solutions of the MFG system with density constraints. 

Definition 4.1. We say that (u,m, (3, /Jt) is a solution to the MFG system (4.1) if 

(1) Integrahility conditions: (3 is a nonnegative Radon measure on (0, T) x T d , (3t € L 1 (T rf ) is 
nonnegative, u G W([0,T]xT d )nL r ([0,T]xI d ), Du € L r ([0,T]xT d ;l d ), m € L 1 ([0,T]xT d ) 
and 0 < m < m a.e., 

(2) The following inequality 

— dtu + H (x, Du{t , x)) < /(x, m) + f3 

holds in (0, T) x T d in the sense of measures, with the boundary condition on 

g < u{T~,-) = g + p T a.e. 


(i) 

—dt.u + H(x, Du) 

= 

/(x, m) + P 

in (0, T) x T 0 ' 

(ii) 

dtm — div ( mD p H(x , Du)) 

= 

0 

in (0, T) x T 0 ' 

(hi) 

u{T,x) = g{x) T (3 t ? 

Pt > 0 , 

Pt(TT — m) = 0 

in T d 

(iv) 

0 < m, < rn 

/3>0, 

P(m — m) = 0 

in (0, T) x T d 

(v) 


(p 

II 

0 


in T d 


(4.2) 
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Moreover, f3 ac = 0 a.e. in {m < m} and 

limsup m £ (t, x) = m /3 s — a.e. if t < T and a.e. in {/3t > 0} if t = T, (4.3) 

£—^0 

where rn e is any standard mollification of m. 

(3) Equality 

dtm — di v(mD p H (x, Du(t , x)) = 0, m(0) = mo 

holds in the sense of distribution, 

(4) Equality 

f f m(—H (x, Du) + Du ■ D p H[x, Du) + f(x, m) + (3 ac ) dx dt 
Jo J T d 

+rn/3 s ((0, T) x T d ) + rh / fir dx = / mo(i)«(0 + , x) — m(T, x)g{x) dx 

J T d Jf d 

holds. 


Let us recall that, in the above definition, (3 ac and /3 s denote the absolutely continuous part and 
the singular part of the measure (3. 

Some comments on the definition are now necessary. Equality (4.3) is a weak way of stating that 
m = m in the support of (3 and respectively, while the last requirement formally says that equality 
—dtu + H (x, Du(t , x)) = f(x, m) + f3 holds. 

We can state the main result of this section. 


Theorem 4.2. Let ( u,a ) £ Kr be a solution of the relaxed Problem 3.6 and ( m,w) € K.r be a solution 
of the dual Problem 3.2. Then a > f(-,m) as measures, and, if we set 

(3 := a \— [0, T) x T d — f(-,m ) dx dt 

and (3 t '■= «L{T} x T d , the quadruplet (u,m, (3, (3t) is a solution of the MFG system (4.1). 
Conversely, let (u,m, (3, /3 t) he a solution of the MFG system (4.1). Let us set 

a := /(•, m) dx dt + f3 + (3t d(<5r <8> TL d L T d ) (4.4) 

and w = —mD p H{x,Du). Then the pair ( u,a ) is a solution of the relaxed problem while the pair 
(m, w) is a solution of the dual problem. 


The proof of this results goes along the same lines as in [13] (Theorem 3.5). However for the sake 
of completeness (and because of some differences) we sketch it here. 

Proof. Let (it, a) £ ICr be a solution of the Problem 3.6 and ( m,w) £ Kr be the solution of Problem 
3.2. First, by the definition of Legendre-Fenchel transform we have for a.e. (t,x) £ [0, T] x T d 

F*{x, a ac (t, x)) + F(x, m(t, x)) — a ac (t, x)m(t , x) > 0. (4-5) 

On the other hand by optimality we have that 
0 = ^4(it, a) + B(m, w) 

= I j F*(x,a ac (t, x))dxdt + ma s ([0,T] x T d ) — f u(0 + , x) m-o(x) dx 
Jo J T d J T d 

+ f g(x)m(T, x) dx + f f m(t,x)H*^~ w(t,x 
J T d Jo Jt 1 


/ T d 
r T 


x,- - - | + F(x,m(t,x)) dxdt 

m(t, x) ' 


> 


f ( a ac mdxdt + ma s ([0,T] x T d ) + f g(x)m(T, x) — it(0 + , x) mo(x) dx 

Jo J T d Jj d 


+ [ f m(t,x)H* dxdt > 0, 

Jo JT d \ m(t, x) J 
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where we used the Lemma 3.7 for the last inequality. This means that all the inequalities in the 
previous lines are equalities. In particular we have an equality in (4.5), which implies 

a ac {t, x) £ d m F(x,m(t,x)) a.e. 


As d m F(x,m(t,x)) = {f(x,m(t,x))} for 0 < m(t,x ) < m a.e., we have a ac (t,x ) = f(x,m(t,x)) a.e. 
in {0 < m < m}. Moreover, as d m F(x, 0) = (—oo, 0] and a ac > 0, we also have a ac = 0 = /(•, 0) 
a.e. in {m = 0}. Finally, since d m F(x,m) = [f(x, m), +oo), a ac > f(x,m(t,x )) a.e. on {m = m}. 
Therefore a ac > a.e. Let us set f3 := a L [0, T) x T d — ff,m)dxdt and /3t ■= qL{T} x T d . 

From Proposition 3.8 we know that /3t = u{T~ , ■) — g. 

Since equality holds in the above inequalities, there is an equality in the inequality of Lemma 3.7: 
thus point 4 holds in Definition 4.1. Moreover, by Lemma 3.7, we have that w = — mD p H (•, Du) a.e. 
and (4.3) holds. In conclusion, since (u,a) £ JCr and ( m,w) £ /Cp, the quadruplet (u,m, /3, (3t) is a 
solution to the MFG system (4.1). 

Now let us prove the converse statement. For this let us take a solution (m, u,/3, /3 t) of the MFG 
system (4.1) in the sense of the Definition 4.1. Let us define a as in (4.4) and w := —mD p Hf,Du). 
We shall prove that ( u , a) is a solution for the Problem 3.6 and (m, w) is a solution of Problem 3.2. 
For the first one, one easily checks, following the argument of Proposition 3.8, that (u, a) £ ICr. Let us 
now consider a competitor (u. a) £ Kr. Using the equality in Lemma 3.7 for (u, a, rn, —mD p H (-, Du)) 
and the inequality for (u, d, m, -mD p H(-, Du)) we have 

A(u,a) = f f F*(x,a ac (x)) dx dt + md s ([0,T] x T d ) — f u(0 + , x)mo(x) dx 
Jo Jj d Jj d 


> 


> 


n 

Jo J T d 

n 

Jo J T d 


s (x, a ac (x)) + m(d ac — a ac ) dxdt + ma s ([0, T] x T d ) — f u(0 + , x)viq{x) dx 

J f d 

s (x, a ac (x)) dxdt + ma s ([0,T] x T d ) — / u(0 + ,x)mo(x) dx, 

J T d 


thus (u, a) is a minimize!' for the Problem 3.6. 

In a similar manner we can show that (m,w) is a solution for Problem 3.2. Hence the statement of 
the theorem follows. □ 


We now briefly discuss the issue of the approximation of any solution to the MFG system with 
density constraints. If F = F(x, m) is strictly convex on [0, m\ with respect to the m variable, then, as 
H* = H*(x,q) is strictly convex with respect to q (because H = H{x,p) is C 1 in p), we can conclude 
that the dual Problem 3.2 has a unique minimizer. In particular, in this case, the m component of 
the MFG system (4.1) is unique. We do not expect uniqueness of the u component: this is not the 
case in the “classical setting”, i.e., without density constraint (see, however, the discussion in [11]). 
For this reason, the fact that one can approximate any solution of the MFG system (4.1) by regular 
maps with suitable property is not straightforward. This is the aim of the next lemma, needed in the 
sequel, where we explain that the (3 component of any solution can be approached by a minimizing 
sequence of Lipschitz maps with some optimality property. 

Lemma 4.3. Let (u,m, /3, /3t) be a solution to the MFG system (4.1). Then there exist Lipschitz 
continuous maps ( u n ,a n ) such that 

(i) u n satisfies a.e. and in the viscosity sense, 

-d t u n + H(x, Du n ) = a n in (0, T) x T d , 

(ii) the pair ( u n ,a n ) is a minimizing sequence for Problem 3.1 and Problem 3.6, 

(iii) (■ u n ) is bounded from below, is bounded in BV([0, T] x T rf ) flL r ([0,T] x T d ) and ( Du n ) is 
bounded in L r ([0,T] x T rf ), 

(iv) (u n ) converges to some u > u in L 1 ((0, T) x T d ) with u = u m—a.e., 
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(v) (a n ) is bounded in L 1 ((0,T) x T d ) and converges in measure on [0,T] x T (/ to a defined from 
(P,Pt) by (4.4), 

(vi) (u,m, (3, (3 t) is a solution to the MFG system (4.1), 

Proof. Let us define a as in (4.4) and recall that, by Theorem 4.2, ( u,a ) is a minimum in the re¬ 
laxed Problem 3.6. In particular, (u, a) belongs to /C» , which means that, if we extend (u,a) by 
(<7, H(-, Dg(-))) in [T, T + 1] x T d , then 

— dt.u + H (x, Du) < a in (0, T + 1) x T d . 

For rj € (0,1) we set u v (t, x) := u(t+rj, x) and a v := r^jja, where t v : [0, T+l) xT d -A [— 77, T+l—rj) xT d 
is the time shift T v (t,x) = (t — rj,x). We then smoothen u v into u v * p £ where e € ( 0 , 77 / 2 ), p is a 
standard even modifier supported in the unit ball of M d+1 and p £ {-) := £~ d ~ 1 p(-/s). We note that 
u 71 k p £ (t, x) for t £ [T — e,T] is a mollihed version of g. We finally slightly modify u 71 k p e so that it 
satisfies the boundary condition: let ( : R A > [ 0 , 1 ] be smooth, increasing, with £(s) = 0 for s < — 1 
and C(s) = 1 for s > 0 . Set ( E (s) = ((e^s), u^ £ {t,x) := (1 - ( £ (t - T))u n ★ p e (t,x) + Ce{t - T)g(x). 
Then u v,£ (T, x) = g{x) and 

-d t u^ £ + H(x, Du v,£ ) < a 71 ’ 6 in (0, T + 1) x T fZ , 

where 

c^ e := [(1 - C £ (t - T)) - H(-, Du*)) * p £ + H(x, Du^ £ ) - - T)(g(x) -g* p £ (t , x))] + 

(observe that the last convolution is done in {d + 1) variables, even if g is a function only depending 
on 1 ). As e —>• 0, u r,,e is bounded in BV and converges to iF in L 1 while a v,£ is nonnegative, bounded 
in L 1 and converges to a 71 as a measure. We have 

A(u v,£ , a v,£ ) = I I F* (x, a v,£ (t,x)) dxdt — 

Jo JT d 

As s —)• 0, the first integral in the right-hand side converges to 


/ 

JT d 


u k p e ( 77 , j)jno(r) dx. 


rr 

Jo J T d 


F*{xfia v ) ac (t,x))dxdt + rn(a ,1 ) s ((0,T] x T d ) 


n 

Jo J T d 


F*(x, a ac {t + 77, a;)) dxdt + ma s ([ 77 , T + 77] x T d ). 

This convergence is technical, but not difficult: without explicit dependence on x this is just the 
combination of the l.s.c. behavior of this integral functional with the fact that convex functionals 
which are invariant by translation decrease by convolution; in the x-dependent case, one just needs to 
estimate the error using the regularity in x. 

Pick now a sequence (g n ) tending to 0, such that uk p e (r) n , ■) converges in L 1 to u(r] n , •) as e —> 0 
(this is the case for a.e. 77) and ( u(rj n , ■)) tends in L 1 to u(0 + , j as n A + 00 : then 

liiri sup lirri sup A(u riny£ ) < lim sup A(u Vn , a Vn ) = A(u,a). 

n s —^0 n 

As (u,a) is a minimum in the relaxed Problem 3.6, we can find e n —» 0 such that (u 71 ™’ 6 ", a Vri ’ £n ) is a 
minimizing sequence for Problem 3.6 thanks to Proposition 3.8. 

Let now u n be the viscosity solution to 

— dtu + H(x, Du) = a £ri ’ Vn in (0, T) x T d 
u(T, x) = g(x) in T cZ . 

Standard results on viscosity solutions imply that u n is Lipschitz continuous (because so are a £n ’ Vn 
and g), satisfies the equation a.e. and, by comparison, is such that u n > u rin,£n . Therefore 

A(un,a en,r,ri ) < A{iF n ’ £n , ofi n,£ri ), 
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so that (u n , a £ri,71n ) is also a minimizing sequence for Problem 3.6. By Lemma 3.5, (u n ) is bounded 
from below, is bounded in BV([0,T] x T d ) nL r ([0, T] x T d ) and ( Du n ) is bounded in L r ([0,T] x T d ). 
Up to a subsequence, (u n ) converges to a BV map u in L 1 such that u > u. Note that, as in the proof 
of Proposition 3.8, (u, a) is also a minimizer of Problem 3.6, so that, by Theorem 4.2 , (u, m, f3, /3t) 
is also a solution to the MFG system (4.1). In particular, by (4) in the definition of solution, the 
inequalities of Lemma 3.7 must be equalities for (u,a) and (u,a) so that, 

/ m(t, x)u(t, x) dx = / m(t, x)u(t, x) dx for a.e. t , £ [0, T], 

JT d J T d 

As u > u, this implies that u = u m— a.e. In conclusion the pair (u n , a Vn,£n ) satisfies our requirements. 

□ 

Remark 4.4 (About the uniqueness of (3 in the solution of (4.1)). Assuming that f is increasing in 
its second variable, we already know the uniqueness of (m,w) (see Remark 3-4). This also gives the 
uniqueness of the density of w w.r.t. m, i.e. of D p H(x, Du), on {m > 0}. Supposing H strictly onex, 
this also gives uniqueness of Du a.e. on {m > 0}. But if we formally differentiate equation (i) in 
(4.1) we obtain only terms depending on Du, hence also D/3 is unique on {m > 0}. Using the BV 
regularity result of section 6 and the fact that (3 vanishes on the non-negligible set {m < m} we infer 
uniqueness of (3. 

4.2. Approximation by classical MFG systems. We now study to what extent the solution of 
the MFG system with density constraint introduced above can be obtained as the limit of the solutions 
of classical MFG systems. For this, we assume that f £ :T d x [0, +oo) —>• R is a continuous function 
for each e > 0, strictly increasing with respect to m, with / £ (-,0) = 0, and which fulfills the growth 
condition: there exists 9 > 1 + d/r and C, C £ > 0 such that 


C'~ 1 m e,_1 — C < f £ (x, m) < C £ m d ~ l + C £ . 

We consider ( u £ ,m £ ) the solution to the classical MFG system 

(i) — dtu £ + H(x,Du £ ) = f £ (x,m £ ) 

(ii) dtm £ — div (m £ D p H(x, Du £ )) = 0 

(iii) u £ (T,x) = g(x), m £ (0, x) = mo(x) 

Following Cardaliaguet [11], Cardaliaguet-Graber [13], we know that the MFG system (4.6) has a 
unique (weak) solution (u £ ,m £ ): namely, ( u £ ,m £ ) € C^QO, T] x T d ) x L e ([0,T] x T d ) and the following 
hold: 

(i) the following integrability conditions hold: 

Du £ £ L r , m e H*(-, D p H(-, Du £ )) € L 1 and m £ D p H(-, Du £ )) G L 1 . 

(ii) Equation (4.6)- (i) holds in the following sense: the inequality 

— dtu £ + H(x , Du £ ) < f(x, m £ ) in (0, T) x T d , 

holds in the sense of distributions, with u £ (T , •) = g, 

(iii) Equation (4.6)-(ii) holds: 

dtm £ — di v(m £ D p H(x, Du £ )) = 0 in (0, T) x T d , m £ ( 0) = mo 

in the sense of distributions, 

(iv) The following equality holds: 

f f m £ (t,x) (f(x,m £ (t,x)) + H*(x,D p H(x,Du £ )(t,x))) dxdt 
Jo J T d 


J-l 


in (0, T) x T d 
in (0, T ) x T d 
in T d 


(4.6) 


(4.7) 


(4.8) 


+ 


m £ (T , x)g{x) — mo(x)tt e (0, x) dx = 0. 


(4.9) 
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In addition, u £ is Holder continuous and in W 1 ’ 1 , and equality —dtu e + H{x,Du £ ) = f(x,m £ ) holds 
a.e. in (0, T) x T rf (see Cardaliaguet-Porretta-Tonon [15]). 

Let us now suppose that f £ (x,m ) —> f(x,m ) uniformly with respect to x for any m < m and 
f £ (x, m) —>• +oo uniformly with respect to x for any m > m as e —> 0 + . 


Proposition 4.5. Under the above assumptions, 

(1) the family (u £ ) is bounded in BV([0,T] x T d ) n L r ([0,T] x T d ) while ( Du £ ) is bounded in 
L r ([0,T] xT rf ), the family (a £ := —dtu £ + if(-, Du £ )) is bounded in L 1 ([0, T] x T d ), with a £ > 0 
a.e., (m e ) is bounded in L e ([0,T] x T d ) while ( w £ ) is bounded in L r, ([0,T] x T d ). 

(2) If ( u,m,a ) is any cluster point for the weak convergence of (u £ ,m £ ,a £ ), then a > f(-,m) and, 
if we set /3 := aL(0,T) x T d and /3t '■= u(T~,-) — g, then the quadruplet (u,m, j3, /3 t) is a 
solution of the MFG system with density constraint (4.1). 


Proof. The proof is a straightforward adaptation of our previous constructions. According to [14], we 
know that ( u £ ,a £ ) is minimizer over /Cr of the functional 

A £ (u,a) = [ f (F £ )*(x, a) dx dt — f ?i(0 + ,a:)dmo(x), 

Jo J T d J T d 

rm 

where F £ (x,m) := / f £ (x,s)ds and ( F £ )* is the Fenchel conjugate of F £ with respect to the last 
Jo 

variable. Then, by convexity, 

( F £ )*(x, a) > am — F £ (x,m), 

where, by our assumptions, F £ (x,m ) converges uniformly with respect to x to F(x,m). Let if be the 
Lipschitz continuous viscosity solution to 

—dtif> + H(x,Dif) = 0 

-if{T,x) = g(x). 


It is also an a.e. solution, so that (^>, 0) belongs to ICr. Then 

A £ (u £ ,a £ ) < A £ {ip,d) < — / V’(O) x) dmo(i) < C. 

JT d 

So {A £ (u £ ,a £ )) is bounded from above and one can then argue exactly as in the proof of Lemma 3.5 
to obtain the bounds on ( u £ ) and (a £ ) as well as a bound for {A £ {u £ , a £ )). 

Following [14], we also know that the pair (m £ ,w £ ) := (m £ ,-m £ D p H(-,Du £ )) is a minimizer over 
K d of 

B £ (m,w)= f g(x)m(T,x) dx + f f m(t,x)L (x, \ + F e (x, m(t, x)) dxdt 

Jjd Jo Jf d \ m(t, x) J 

Since, by [14], A £ {u £ ,a £ ) = —B £ {m £ ,w £ ), (B £ (m £ ,w £ )) is bounded. From our assumption on f £ we 
have therefore that ( m £ ) is bounded in L 9 ([0,T] x T d ) while (w £ ) is bounded in L r, ([0,T] x T d ). 

Let finally (u, a) be a cluster point of (u £ , a £ ) and (m, w) be a cluster point of ( m £ , w £ ) for the weak 
convergence. Then, standard arguments from the theory of T-convergence show that ( u,a ) minimizes 
A while ( m,w ) minimizes B, so that, if we set (3 := a L (0, T) x T d and /3 r := u(T~,-) — g, the 
quadruplet (u,m, (3, fir) is a solution of the MFG system (4.1) according to Theorem 4.2. □ 


5. No COUPLING, SPACE HOMOGENEITY, POWER-LIKE HAMILTONIANS AND mo < m 

In this section, we study through an example some finer properties of the solutions of (4.1). Let us 

consider f(x,m ) = 0, for all (x,m) G x [0,+oo), H(x,p) = -|p| s (s > 1) and T = 1. The terminal 

s 

cost g is a given smooth function. As usual, we assume that the initial density of the population 
satisfies mo < rrt — c a.e. in T (/ for a given constant 0 < c < rrt (here this assumption will be essential, 
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while it is not clear whether for the considerations of the previous sections it is purely technical or 
not). For simplicity, let us set s = 2. In this case the functional B for the Problem 3.2 has the form 

n l \w\ 2 f 

- b F(x, m) dx dt + / g(x)m(l, x) dx, 

•d 2 m Jjd 

where we use the convention (3.3). Let us also chose F(x,m ) = 0 for m £ [0,m] and F = +oo 
otherwise. This functional recalls the one introduced by Bemamou and Brenier to give a dynamical 
formulation for the Monge-Kantorovich’s optimal transportation problem (see [4]). Only a constraint 
on the density m and a penalization on the final value have been added. 

Indeed, forgetting for a while the density constraint, Problem 3.2 can be reformulated as 

min |^W!(mo,mi) + J gm\dx : m\ £ V(T d ), < m| . (5.1) 

We remark that the above formulation gives always a geodesic curve connecting mo and mi (thus 
m* is defined for all t. £ [0,1]). Since the admissible set in the above problem is geodesically convex 
(and is a convex set), the density constraint is satisfied as soon as it is satisfied at the terminal 
time. Hence the problem in (5.1) is completely equivalent to Problem 3.2. Actually we can prove 
something more: if the initial density satisfies strictly the constraint, then saturation may happen 
only at the final time. This result is not a straightforward consequence of geodesic convexity, and we 
give a complete proof of it here below. 


Lemma 5.1. Let mo < m — c (for a given constant 0 < c < m) a.e. in T d and m\ be the solution 
of Problem 5.1. Let ( nit ) be the geodesic connecting mo to m\. Then, for any t £ (0,1) we have 
\\mt\\ L °° < ra (1 _ f)+ A a i/ d)d , where A := (m - c)/m < 1 (note {1 _ t) + txl/d)d < 1 for t < 1). 

Proof. As we mentioned before, since the admissible set in Problem 5.1 is geodesically convex, we 
get nit < Lh a.e. in T d for all t € [0,1]. On the other hand, since m^ is absolutely continuous for all 
t £ [0,1] we know that there exist optimal transport maps T l , S t : T d —> such that (T^^m-o = m{ 
and (S t )#mt = mo with T 1 o S l = id. The maps (Sf) and ( T t ) are given by McCann’s interpolation 
in terms of S 1 and T 1 respectively, which is Tt := (1 — f)id + tT 1 and St = fid + (1 — t)S 1 . Moreover 
T t and S t are countably Lipschitz (i.e. the domain can be decomposed, up to negligible sets, into a 
countable union of sets where these maps are Lipschitz continuous), hence we can write the Jacobian 
equation 

det (DT t ) = 


m 0 


m t o T t 


Hence, the density mt is given by 


m t = 


m 0 


det (DT t ) 

Using the concavity of det 1//rf (for positive definite matrices) we obtain that 
det (DT t ) = det ((1 - t)I d + tDT 1 ) > ((1 - t) + t det(DT 1 ) 1 ^ = ((1 - t) + t 


(5.2) 


i/fp 


> ((l-i)+tf=T 


m 


l/d 


Hence by (5.2) we have that 


m t < 


m 0 o S t 


(a - t )+t^) i/d y 

Let us set A := (m — c)/m < 1. Then, for any t £ (0,1) we have 

_ A 

Rif < m---- — 7 — , , 

“ (1 — f) + t\ l / d ) d 
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and the coefficient jx^y^Tjdy. is strictly less than 1 for every t, A < 1. □ 

5.1. Some properties of f3,(3\ and u. Let us discuss now some further properties of f3,/3± and u. 

Proposition 5.2. Let (u,m, /3, /3\) be a solution of the MFG system with density constraints and let 
us assume that we are in the setting of this section. Then (3 = 0 and u and (3\ are bounded. 


Proof. From Theorem 4.2, we know that the pair (m, — mD p H(-, Du)) is a minimize!' of B. In view of 
Lemma 5.1, we have therefore m(t,x) < m for a.e. (t,x) £ (0, T) x T d . By Definition 4.1, this implies 
that /3 ac = 0. Recall on the other hand that 


limsupm e (t, x) = m /3 s — a.e. if t < 1, 
£—^0 


where rn £ is any standard mollification of m. But, still by Lemma 5.1, for any t € (0,1), we get an 
upper bound on m E (t,x) which is strictly less than m. Hence, (3 s = 0 on [0,1) x T rf . 

Let us now check that u is bounded. We note that, as (3 = 0 and H satisfies the growth condition 
(2.1), u satisfies a.e. the inequality — dtu + |Du| 2 /2 < 0 in (0,1) x T d . Thus, if we mollify u in the 
usual way, u £ is a classical sub solution to —dtu £ + |Du £ | 2 /2 < 0 on (e, 1 — e) x T d . By Hopf’s formula 
we get therefore 

u £ (t , x) < inf [u £ (l - e, y) + C-j^ —r + C( 1 - t) \ V(t, x ) £ (e, 1 - e) x T d . 
yer d { (1 -e-t) J 

Hence 

u £ (t,x) < inf {u £ (l — e,y) + C} V(i, x) £ (e, 1/2) x T d . 

y gT d 


Recalling that / u(t,x)dx is bounded for a.e. t (see the proof of Lemma 3.5), we also have that 

J T d 

/ u £ (t,x)dx is bounded as well for all t and therefore inf u £ (l,y) is bounded from above. So we 
Jfd j/ST d 

have proved that u £ is bounded from above by a constant Co on (e, 1/2) x T d , where Co is independent 
of e. This shows that u is bounded from above by Co on (0,1/2) x T d . 

Let us set z(t, x) := (Co + || H(-, 0)||x,oo) V ||(?||i,°o — || H(-, 0)Hz. 00 (1 — t). Then z is a subsolution to 
— 8tz + H(x, Dz) < 0 which satisfies z( 1, •) > g and z( 0, •) > Co > u( 0, •). Therefore the map u(t, x) := 
u(t, x) A z(t, x) is still a subsolution (because H = H(x,p) is convex with respect to p), which satisfies 
u(0, ■) = u( 0, •) a.e. and g(x) < u(l~ ,x) < u(l~ ,x). Let us set a := (u(l _ , ■) — g) d(<5i <8> 3i d L T d ). 
Then the pair (u, d) belongs to K.r and by optimality of (u, a) we have 


A(u, a) = / (u( 1 , x) — g(x)) dx — / mo(x)u(0, x) dx 

Jfd Jjd 

<A(u,d)= / (^(l - , x) — g(x)} dx — / mo(x)u(0,x)dx. 

J T d J T d 


As u( 0, •) = u{ 0, •) and u{l~,x) < u(l~,x), this proves that u(l~,x) = u(l~,x) a.e., which means 
that u(l - ,-) is bounded from above. Since we already know that u is bounded from below (see the 
proof of Lemma 3.5), we have established that u( 1~, •) is bounded. By Hopf’s formula, this entails 
the boundedness of non (0,1) x T d , from where the boundedness of f3\ follows as well. □ 


Remark 5.3 (Nash-type equilibrium). For this example a notion of Nash equilibrium can be formu¬ 
lated by the means of (m, /?i), i.e. by the means of the “additional price” j3i to be payed by the agents 
at the final time. This price, whose value is precisely (3\ = (w(l~, •) — g), clearly has to be payed only 
if agents arrive to the saturated zone at the final time. Let us postpone the precise definition and the 
details on the question of the Nash equilibrium, which will be established for more general cases in 
Section 7 (see Definition 7.9). 
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6. Regularity of the “additional price” (3 

In this section we show, under some additional regularity assumption on the data, that the measure 
j3 is absolutely continuous and belongs to L^ d ^((0 ,T) x T rf ). In this respect, our model recalls 
those studied by Brenier (see [7]) and later by Ambrosio-Figalli (see [2, 3]), where they analyzed the 
motion of incompressible perfect fluids driven by the Euler’s equations. 

We will see in the next section that this regularity is essential in order to define Nash equilibria 
in our context. For this, we assume in addition to the previous hypotheses the following conditions: 
there exists A > 0 such that 

(HP1) (Assumption for H ): H and H* are of class C 2 with 

A I d < D 2 pp H < A" 1 /* and A I d < D 2 qq H* < A ~ l I d , (6.1) 

\D 2 xx H*(x,p )| < C(1 + \p\ 2 ), \D 2 xp H*(x,p)\ < C(1 + \p\). (6.2) 

(HP2) (Assumption on F ): / is of class C 2 on T d x [0,m] and, for any m £ [0,m] and a > 0, 

F(x, m) + F*(x, a) — am > — \a\ — f(x, m)\ 2 + p(jn — m ), (6-3) 

where p = (a — f(x,m))+ and a\ = a — p. 

(HP3) (Assumption on g): g is of class C 2 . 

Remark 6.1. Observe that the assumption (HP2) is fulfilled if d 2 a F*(x,a ) > A on (0 ,f(x,m)) for 
some A > 0. This assumption of course holds if f(x,m) = 0. If f(x,m) > 0, since d a F*(x, f(x,m)) = 
m on (0,m), the Implicit Function Theorem implies that da a F*(x,a) = l/d m f(x,m), which means 
that the assumption is indeed satisfied as soon as d m f(x,m ) is bounded from above on (0 ,m), which 
makes it a very natural assumption. Among the examples that we have in mind, we underline the case 
where H(x,p) = \p\ J /2 — f(x) and F(x,m ) = 0 if m £ [0,m] and +oo otherwise. Notice that the same 
example could be written with F(x,m ) = f(x)m if m £ [0,m] and +oo otherwise and H(x,p) = \p\ 2 /2 
(these different expression give rise to the same global and individual problems), but in this case (HP2) 
would not be satisfied (and also (H4) would be violated). 

Theorem 6.2. Let (u,m, /3, fir) be a solution of the MFG system (4.1). Under the above assumptions, 
/(-,m(-,-)) £ H( oc ((0,T) x T d ) and [3 is absolutely continuous in (0,T) x T d with 

(3 £ L 2 oc ((0,T)-BV(T d )) ^ Tf o / c (d " 1) ((0,r) x T d ). 

As we said, the proof is largely inspired by the works of Brenier (see [7]) and Ambrosio-Figalli (see 
[2]) on the incompressible Euler’s equations. 

Proof of the Theorem 6.2. By abuse of notion, we use B(m ', v') meaning B{m ', m!v') for any admissible 
pair {m' in the dual problem (v' denoting the velocity field). 

Throughout the proof, (it, m, (3, fir ) is a fixed solution of the MFG system (4.1) and we define a by 
(4.4) and set w = —mD p H(x,Du). Recall that ( m,w ) is a minimizer for B. We also set v := w/m 
and construct competitors m s,ri v s,v ) in the following way: let us fix 0 < t\ < t 2 < T and let 

C € C'^°((0, T); [0,1]) be a smooth cut-off such that ( = 1 on [ti, ^ 2 ]; for p > 0 small and 6 £ small 
(such that t + ((t)p £ (0, T) for all t £ [0, T]), we denote 

m 6,ri (t, x) := m(t + ((t)p , x + ((t)6) 
the time-space translation of the density and let 

v 5,v {t , x) := v(t + C {t)g, x + C(t)5)(l + vC '(*)) - (\t)6 

the velocity field associated to m s,v . Indeed, by construction (m s,ri ,m S ' v v s,T1 ) solves the continuity 
equation, and satisfies the other constraints. 

Step 0. Let us collect some tools now. 
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First, we have 

B[m*'", v s ’”) < B(m, v ) + C{g 2 + |h| 2 ). (6.4) 

Indeed, let us denote by the inverse map of 1 1 ->-1 + £(i)r/. Then, after changing variables, 


I o Jf d 


[m(s, y)H* (y - t{€ v {s))S, ~v(s, y){ 1 + r/C'^s))) + C'(^(s))<5)) 

+ T(y-C(^(s))5,m(s,y))]^(s)dyds+ [ g(y)m(T,y)dy. 

JT d 


In view of our C 2 regularity assumptions on H*, F and g, the map (rj,S) i—>• B(m s,ri , v s,r> ) is C 2 . We 
obtain (6.4) by optimality of (m,v). 

Second , by stationarity of the problem for B (it is enough to consider perturbations of form 
(m 0,?? , v 0,v ) for £ with compact support, not necessarily 1 on [^i, ^ 2 ]) 5 we have 


[ 

J T d 


{m(H*(x, —v(t, x)) + D q H*{x, —v(t, x)) ■ v(t, x)) + F(x, m(t , x))} dx = constant. 


From our assumption on H *, we have 


A, 


H*(x,-v) + D q H*(x,-v) ■ v < H*(x, 0) - -|u| 2 . 


Thus 


ess 


— sup te r 0 T i / m(t, x)\v(t, x)| 2 dx < C. 

J T d 


By (6.1), we have D 2 q H* < (1/A )Id and therefore (6.5) implies 


ess — 


su Pte[o,Tl / m(t,x)\D q H*(x,-v(t,x))\ 2 dx < C. 

JT d 


(6.5) 


( 6 . 6 ) 


Third, for any smooth map ( u',a'), with a' > 0, and ( m',w') G JCd (where v' = w'/m') competitor 
for the primal and the dual problems respectively, we have 

A(u', a!) + B(m', v') > f [ {m'{H{x, Du') + H*(x, — v') + v' ■ Du')} dxdt 

Jo J T d 

+ /. ,m') + F*(x,a') — a'm'} dxdt. 

Jo J T d 

In view of our assumptions on (HP1) and (HP2), we have the key inequality 


A{v!, a') + B{m', v') > 


A 


1 0 JT d 


m'(t, x)\Du' — D q H*{x, — 1 /)| 2 dxdt 


+— f f m'(t, x)\v' + D p H{x, Du')\ 2 dxdt (6-7) 

4 Jo Jt 1 

^ — \a > 1 — f(x,m , )\ 2 +p , (rfi — m')\ dxdt 


+ 

JO J T d 

where p 1 = (a 1 — f(x,m))+ and a\ = a' — p 1 . 

With the help of these tools let us show now the statements of the theorem. 


Step 1. We first check that /(-, m) € H^ oc (( 0, T) x T rf ). Let us fix (m', v') to be a smooth competitor 
for B and let ( u n ,a n ) be the minimizing sequence for Problem 3.6 defined in Lemma 4.3: we know 
that (a n ) is bounded in L 1 and converges to the (nonnegative) measure a defined from ((5, (Jt) by 
(4.4). Then, passing to the limit in the inequality 

A{u n , a„) + B(m!, v') > / / {F(x, m!) + F*(x, a n ) — a n m'\ dxdt, 

Jo Ji d 
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inf A 

IC R 


we get 

+ B(m',v')> f f {F(x,m') + F*(x,a ac ) — a ac m'} dxdt + f f (m — m')da s . 

Jo J T d Jo J T d 

In view of the proof of Theorem 4.2, we have a ac > f(-,m), with an equality in { m < m}. So, if we 
set as above p = (a ac — f(x,m)) + and a f c = a ac — p, then af c = f(-,m). By (6.3), this implies that 

r T 

inf A 


>Cr 


+ B(m',v')> f [ ^-\f(x,m) - f(x,m)\ 2 dxdt, 
JO J T d z 


an inequality which remains true for any (rn 1 , v r ) G ICd (not necessarily smooth ones). Adding inf A 


to inequality (6.4) and using the duality inf A + min B = 0 we have 

ICr K-d 

inf A + B(m S ’ v , v S ’ v ) < C(r] 2 + |d| 2 ), 
ICr 


ICr 


( 6 . 8 ) 


which implies 


[ f \f(x,m) — f(x,m s,v )\ 2 dxdt<C(ri 2 + \5\ 2 ) 
Jt i J T d 


and the regularity of / in x allows to conclude f(-,m) G H/ oc ((0,T) x T rf ). 

Step 2. Let ( u n ,a n ) be the minimizing sequence defined by Lemma 4.3. Without loss of generality, 
we can assume that 

(6.9) 


A(u n ,a n ) — inf .4, < 1/n. 

ICr 

We set p n := (a n - f(-,rn)) + and ai, n := a n - p n . For p : [0,T] x T d 
define the average of p on the [t,t + rj\ by 


and for rj > 0 small, let us 


<P‘ 


'(t,x) := [ p{t 
Jo 


+ Op, x) dd, 


which is well-defined on [^i, ^ 2 ] x With this procedure, we similarly define the functions p/, a 1 /, 
etc. Let us take moreover a G [0,+ 00 )). 

The aim of this step consists in estimating the quantity 

I := [ [ a(t)m\pl(t,x + 5)-pl(t,x)\6xdt. 

Jt 1 Jt 1 

Namely, we prove that 

I < C\\a\\ L : , ( |<5| + (l + ^) (1 In + |-5| 2 + r] 2 ) 1 ^ 

+C'||cr||i,oo(l/n + rf + \5\ 2 ) 1 ^ 2 (1/n + rj 2 + l^l 2 ) 1 ^ + |<S| ^1 + (1/n + rj 2 + Ih] 2 ) 1 / 2 ) (6.10) 

+C'{|I c t|Il 2 + ||o-||l°o (1/n + \6\ 2 + t] 2 ) + (1/n + \5\ 2 + rj 2 ) 1 ^ 2 j (1/n + |d| 2 + r/ 2 ) 1 / 2 
= : X(a, 1/n, 5,r]). 

We will show in the last two steps that this inequality easily entails the desired estimates on p and /3. 
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The proof of (6.10) is quite long and relies on the combination of (6.7), (6.8) and (6.9) which imply 
that 

rt2 


1/n + C(rj 2 + \S\ 2 ) > ~r f [ m s,ri (t, x)\Du n — D q H*(x, — v S ’ v )\ 2 dx dt 

4 J tl Jjd 

^ f f m S ’ v (t,x)\v S ' v + D p H(x,Du n )\ 2 dxdt 

Jti Jr d 


+- 


+ 


n 

It i J T d 


^|ai,n - f{x,m S ’ v )\ 2 +Pn{m - m S ’ r, )\ dxdt 


We have 


< f f cr(t)(m — m(t,x))|p(((f,x + J) — p 7 J(t,x)\ dxdt 

Jti Jj d 

+ [ f a(t)m(t, x)|p(((i, x + 5) — p(((t,x)| dxdt 

Jti Ji d 


't i 

= ■ hi + I 02 

where the the first term can be estimated as follows: 

rt2 

hi < Ml™ 

= lk|| L o° 

^ 11 (7 || £oo 

+ llcrllz/ 00 

Now by (6.11) we obtain that 

For the second term we have 
7q2 < 


f [ (m -m(t,x)){\p r } l (t,x + (5)| + |p^(t,x)|} dxdt 
Jti J T d 

rl rt 2 r 

d0 / (m - m(t,x)) {p n (t + 0r],x + 5) + p n (t + 9r],x)} dxdt 

Jo Jti Jj d 

f d of j (m — m~ S ’~ 0v )p n dx dt 
Jo Jo J T d 

f dO f f (fn — m 0, ~ ev )p n dxdt. 

Jo Jo J T d 

hi < C\\a\\ L ™(l/n + |<5| 2 + rf). 

[ [ a (t)m(t,x)\ot!l(t, x + 6) — a 7 J(t,x)\ dxdt 

Jti J T d 

+ / / a{t)m\a{ (t, x + J) — ol[ n (t, x )\dx dt 

Ju Ji d 


:= h+h- 

To estimate the term Ii, let us compute 


a , 


= ~V 

+ ff 


( 6 . 11 ) 


\(t,x + 5) — cQ(t, x) = f —d t u n (t + 0ipx + 5) + H(x + 5,Du n {t + 0i),x + 5))d0 

Jo 

- / —d t u n (t + Or), x) + H(x,Du n (t + 0rj,x)) dd 
Jo 

1 / [Du n (t + rj, x + s5) — Du n (t , x + s<5)] • 6 ds 

Jo 

D X H(x + s5, Du n (t + Or), x + sS)) ■ 6 dsdO 

+ f d of D p H(x + s5,£, s ) ■ [Du n (t + 0r),x + 5) - Du n (t + 0rj,x)]ds 
Jo Jo 


d 0 
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where := (1 — s)Du n {t + Or], x) + sDu n (t + Or], x + 5). Thus, 

^(t, x + 5) — a 7 J(t, x)| < [ \Du n (t + rj,x + sd) — Du n (t,x + sd)\ds 

Jo 


a 1 


1 0 
1 nl 


+ H 



| D x H{x + sd, Du n (t + Or], x + sd))| ds d0 


o Jo 

l ri 


+ 


| D p H(x + s5, £ fl )| | Du n (t + Or], x + d) — Du n (t + Or], x)\ ds d$. 


o Jo 


In view of our assumption (6.2) on D X H and D p H: 

n cr(t)m(t,x) |a)((t,x + 5) — a^{t,x)\ dxdf 
' d 


h = 


< 1% 1 
+ C\5l 
+ C 





ti Ji d Jo 


(j(t)m{t, x)\Du n (t + r],x + sd ) — Du n {t,x + s<5)| dsdxdt 




i 



G 


ti JT d Jo Jo 


(t)m(t,x) {l + | Du n {t + 0r/,x + s<5)| : } dsd#dxdt 


*2 


l 


Jv d Jo 


a(t)m(t,x ) {1 + | Du n {t + 0i],x)\ + \Du n (t. + 0r],x + 5)|} 

x \Du n {t + 0i], x + <5) — Du n (t + Or], x)\ d 0 dx df 


:= hi + 1 12 + h 3 - 
For In, we have 

In < \S\v ~ 1 f 2 [ 

Jti JT d Jo 


G 


(t)m(t, x)(\Du n (t + r], x + sd) — D q H*(x, —v(t, x))| 


< 


\S\v ~ 1 [ 

J ti 


+ | D q H*(x, —v(t, x)) — Du n (t, x + s<5)|) j ds dx d t 

i-2+V f fl 

G°~ ri (t)rn~ sS ~ ri (t,x)\Du n (t,x) — D q H*(x — sd, — u -s5,-r? (f, x))| dsdxdt 



ti+77 JT d J 0 
rt2 


1 


+ \d\rj 1 I II G(t)m sS ’°(t,x)\Du n (t, x) — D q H*(x — sd, — v s5,0 (t, x))| ds dx dt 

Jt i Jr d Jo 

By Cauchy-Schwarz and (6.11) we obtain: 

hi < C\d\ri~ l \\G\\ L 2 (l/n + r] 2 + |J| 2 ) 1/2 . 

We now estimate I± 2 , that we bound from above as follows: 

ft 2 r rl rl 


h2<c\\a\\ L 2\d\ + c\d\ 


+ C\s\ 




1 r 1 



ii JT d Jo Jo 


a(t)m(t, x)\D q H*(x, —u(t,x))| 2 dsd@dxdt 

ti jf d Jo Jo 

G(t)m(t,x ) {| Du n (t + 0i], x + s5)| 2 — \D q H*(x, —u(t,x))| 2 } dsd^dxdf 
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The second term can be estimated by (6.6), while, for the third one, we use the inequality |a| 2 — |6| 2 < 
|a — b\ 2 + |a — b\\b\ to get: 

h2 < C , || cr llL 2 l^l + 

+ CIIctIIloo|<5| [ [ [ [ m(t,x)\Du n (t + Or),x + sd) — D q H*(x, — v(t,x))\ 2 dsd#dxdi 

Jt i J T d JO Jo 


+ 


2C\\ct\\l°o\ 5\ f [ [ [ \m(t,x)\Du n (t + 6r),x + sd) — D q H*(x,—v(t,x))\ 
Jt 1 Jf d Jo Jo l 

x | D q H*(x, —v(t, x))| 1 ds dO dx d t 


<C\\a\\ L 2\S\+ 


+ C , || < t||l o ° |^| [ f I I m sS ' er> (t, x)\Du n (t, x) — D q H*(x — sd, — v s5 ’ 0T? (t, x))| 2 dsd^dxdt 
J ti+6r) Ji d Jo Jo 


1 rl 


fl 2 + 0 ri r rl rl f 

+ 2C\\a\\L°°\6\ / / / \ m~ sS ~ dll {t,x)\Du n (t, x) - D q H*(x - sd,-v~ sS ~ dr, (t, x))| 

Jt-L+Or) JT d Jo Jo l 

x | D q H*(x — s5, — v~ sS ~ 9v (t, x))|| dsdflcUcdi. 

As before, using the energy estimates (6.6) and (6.11) together with a Cauchy-Schwarz inequality in 
the last integral we obtain 

I \2 < C'||cr|| L2 |<5| + C'||o‘||l°° |<5| |(l/n + rj 2 + |<5|^) + C(l/n + ?? 2 + l^l 2 ) 1 ^! • 

It is easy to see that with the help of the estimations for In and I \2 we can estimate /13 as well. 
Hence we obtain 

I13 < C\\cr\\ L 2(l/n + |d | 2 + r ] 2 ) 1/2 

+ C jc'llallla + C'||cr||z,oo (1/n + |<5| 2 + rj 2 ) + (1 /n + |<5| 2 + r/ 2 ) 1 / 2 j- (1/ra + |<5| 2 + rj 2 ) 1 ^ 2 . 

Let us now take care of I 2 ■ Setting f v (t, x) := / f(x, m(t + 9r], x)) d 9, we have 

Jo 

[ [ a(t)rn\ot{ n (t,x + 5) — ot[ n {t,x)\ dxdt 

Jt 1 Jr d 

f f a(t)m\al n (t,x + 6) — f v (t,x + 6)\dxdt + f f <r(t)m|/ ,? (i, x + 5) — f v (t, x)| da™ dt 

Jt 1 Jf d ’ Jtx Jj d 

+ [ [ a(t)m\f v (t,x) — ai n (t, x)\ dxdt 

Jti J T d 


h = 


< 


hi + h2 + ^ 23 - 

Since 


hi < 


< 


C I [ [ &(t)\ a i,n(t + Orj, x + 5) — f(x + 5, m(t + 0?/, x + <5))| d6 dx dt 

Jt 1 JT d Jo 

n t2—8ri r 

/ cr ev {t)\ai^ n (t, x) — f(x,m(t,x))\ dxdf d0 

1—077 JT d 
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we obtain by Cauchy-Schwarz and (6.11): 

hi <C\\a\\ L 2(l/n+\5\ 2 + rj 2 ) l/2 . 

The term I 23 can be treated in the same way. For I 22 , we have 

I 22 < C||cr || L 2 [ ( [ [ \f(x + 6,m(t + 0p,x + 5))-f(x,m(t + 9p,x))\ 2 dxdt 

Jo \Jt 1 J T d 

<C\\a\\ L2 \5\ 


1/2 


d e 


because /(-,m(-,-)) is in //^((O, T) x T d ). 

Putting the above inequalities together gives (6.10). 


Step 3. We now show that p n := (a n — /(-,m)) + belongs to the space L 2 ([ti,t 2 \] BV(T d )). Let us 
take a test function £ (^((O, T) x T d ), e € M n with |e| = 1, 77 > 0 small and let us set 5 := rje. Let 
us estimate 



a -, {t) i2Sh±d£Sh^ Pn(trX)ixit 


V 


rt 2-ii r 

/ / <r{t) 

JT d 


if(t, x) — if(t, x — 5) 


'tl-T) 

rt2-v 




Pn(t, x ) dx df 


ft 2 ~v r 

/ / tr(t)i!>{x) 

J t\— 77 «/T d 


Pn(t,x) ~Pn{t,X + 5) 

V 


dx dt 


V iti -77 7T d 

< ||V’||l°°-^(ct, l/n,r]e,r)). 

V 


Pn(t, x + (5)| dx dt 


First let us recall that p n p as n —>■ +00 in 9Jt([0,T] x T rf ), which allows us to pass to the limit in 
the above inequality as n —> +00 and obtain 



a 


-r V ( t ’ X ) - 


\ty 


d p(t, x) < 


\l°° -X(a,0, ije, 77 ). 
V 


Now sending p —> 0 and recalling (6.10) we have 



a (t)VV’(L %) ' e dp(t, x) < C'||V ; IU 00 |MIl 2 - 


Therefore we obtain that p £ L 2 ([ti,t 2 ]', BV (T d )) ‘-A L 2 ([ti,t 2 ];L d ^ d ^ (T d )) and in particular, by the 
arbitrariness of t\ and t 2 and by an injection we have p £ L d ^ d 1 ^((0,T) x T rf ). 


Step 4■ Conclusion: as 0 < a n < p n + f(-,m ) and (a n ) converges to a dehned by (4.4), we have 
0 < P < p + in (0, T) x T d . This proves that f3 is absolutely continuous and belongs to 

^((O.TjxT^). □ 

Remark 6.3. Note that by the example provided in the Section 5 we have the sharpness of the above 
integrability result in the following sense: we cannot expect a bound for p n in L d ^ d 1 ^((0, T] x T d ), 
i.e., up to the final time, because of the occurrence of a possible jump at t = T. 
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7. Nash equilibria for MFG with density constraints 


Let us suppose in this section the additional assumptions (HP1), (HP2) and (HP3) as in Sec¬ 
tion 6 . To define a proper notion of Nash equilibrium, we use the techniques for measures on paths, 
corresponding the trajectories of single agents. This will also allow us to clarify the meaning of the 
control problem (1.4). The used machinery is inspired by [3] (Section 6 ) and also by [11] (Section 
4.3) and [12] (Section 4). We remark also some similarities of this approach with the works modeling 
traffic congestion and Wardrop equilibria (see [ 6 , 16]). 

7.1. Density-constrained flows and a first optimality condition. Let us recall that T denotes 
the set of absolutely continuous curves 7 : [0, T] —> T d and V 2 CT) the set of Borel probability measures 
fj defined on T such that 

| 7 (s )| 2 dsdr)( 7 ) < + 00 . 

We call fj an almost density-constrained, flow if there exists C = C(fj) > 0 such that 0 < < C(fj ) 

a.e. in T d for all t £ [0,T], where frit '■= (et)#fj. If C(fj) < m (the density constraint, given by our 
model) then we call fj a density-constrained flow. Let us recall moreover that we use the definition of 
the Lagrangian as L(x,v) = H*(x, —v). 

In the whole section we consider a solution (u,m, fl, At) of the MFG system (4.1). By Theorem 
4.2 and Theorem 6.2 this corresponds to ( u , a ) and ( m , w) solutions of Problem 3.6 and Problem 3.2 
respectively, where 

a = /(•, m) dx df + (3 dx df + flr d(5r ® TL d LT (/ ) and w = —mD p H(x, Du). 

Let us state the following results (in the spirit of Lemma 4.6-4. 8 . from [ 11 ]) which characterize the 
density-constrained flows. 



Lemma 7.1. Let fj £ V 2 (T) be an almost density-constrained flow and set mt '■= ( ct)#fj ■ Then 
(i) for all 0 < ti < t 2 < T we have 

/ u(tf ,x)fh(ti,x) dx < / u(tf, x)fh(t 2 , x) dx + / / 7 (f)) dt dfj(j) 

JT d Jf d Jr Jt 1 

r*2 


+ / / a(t,x)fh(t,x) dx dt. 

Jt 1 Jt 1 


(we recall a(t , x) := f{x, m(t , x)) + fl(t, x)) 
(ii) In particular, for all 0 < t\ < T 


!fd 


u(tf ,x)fh(ti,x) dx < / (g{x) + fiT(x))fh(T,x) dx+ 


I T d 
r-T 


r Jo 


^(7(*),7(i))di dfj(j) 


+ / a(t,x)fh(t,x)dxdt. 

Jo Jt 1 


Proof. Let us recall that u satisfies, in the sense of measures, 

—dtu + H(x, Du) < a in (0, T) x T d , 

where a belongs to L^ d ^ ((0, T) x T d ) thanks to Theorem 6.2. If we regularize u into u n and a into 
a n by convolution (with a compact support in B 1 / ri ( 0 )), we obtain 

~d t u n + H(x, Du n ) < a n + r n in (1/n, T - l/n) x T l , 

where 

r n (t, x) = H(x, Du n (t, x)) - H(-,Du) -k p n (t,x). 
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Note that (r n ) tends to 0 in L 1 ((0, T) x T d ). By the way, if H is independent of x, one also has r n < 0. 
Let us fix 0 < t\ < t 2 < T and n large. Now for any 7 £ Lf 1 ([0, T]) we have 

^u„(t, 7 (t)) - £ L( 7 (s), 7 (s))ds^ > d t u n {t^{t)) - H(^(t), Du n (f, 7 (f))) 

> -a n (t, 7(i)) - r n (t, 7 (t)). (7.1) 

Integrating this inequality on [ti,t 2 \, then over T w.r.t. 77 , we obtain 

[ u n (ti,x)rh(ti,x)dx < [ u n (t 2 , x)rh(t 2 , x) dx + [ f j(t)) dt dfj(y) 

Jr d Jf d Jr Jt! 

+ f f [a n (t,x) + r n (t, x)]rh(t,x)dtdx. 

Jj d Jt 1 

We recall the fact that m € L°°([0, T] xT d ). Since (u n ) strongly converges in L 1 to u € BV([ 0 ,T] xT 6 *), 
we have the existence of J C (0, T) of full measure such that for every t±,t 2 £ J,t\ < t 2 , the first two 
integrals pass to the limit as n —> + 00 . By the strong convergence in t 2 ] x T d ) of (a n ) to 

a and in L 1 ([ti, t 2 ] x T rf ) of (r n ) to 0, we can pass to the limit as n -7 +00 is the last integral as well. 
So, for a.e. 0 < t\ < t 2 < T, we have 

/ u(ti,x)m(ti,x) dx < / u(t 2 ,x)fh(t 2 ,x) dx + / / L{p/{t), 7 (f)) dt dfjfr) 

J T d Jr d Jr Jt 1 

+ / / a(t,x)rh(t,x)dtdx. 

J T d Jt 1 

In order to show that the inequality holds for any ti < i 2 , let us now check that 

lim / u((t') + , x)rh(t, x) dx = / u^, x)rh(t, x) dx, 
t’-n± Jjd Jjd 

where u((i') , •) is understood in the sense of trace and rh(t, •) is the (bounded) density of the con¬ 
tinuous representative of the map t 1 - 7 - m(t, •) dx (for the L°° weak—* convergence). The above limit 
basically follows from the trace properties of BV functions, but for the sake of completeness let us 
sketch it below. Let u n be a standard mollification in space of u. As u is in BV, u((t') + ,-) con¬ 
verges in L 1 to u^,-) as t' -7 t ± 1 so that u n ((t') + ,-) uniformly converges to u n (t , •). Let us write 

/ u((t’) + , x)rh(t', x) dx as 

J T d 


l T d 


u n ((t') + , x)rh(t '1 x) dx + / (u((t') + , x) — u n ((t') + , x))rh(t f , x)) dx. 


Ijd 


(7.2) 


By uniform convergence of u n ((t') + , •), the first term in (7.2) converges to / u n (t ± ,x)rh(t,x)dx, 

which „ ,hi, a , cioce «o f u(t ± ,x)m(t,x)dx for „ laIg e. Ac for ihe «£ i„ ( , 2 ), « is 

J T d 

bounded by ||«((t / ) + ,-) — u n ((t') + , OIIl 1 ||w||l°o, which, by L 1 convergence of w((f') + ,-) to u 
tends to 0 uniformly in t’. This proves (i). 

For (ii), we just apply (i) for t 2 = T, since u{T~ , •) = g + (3t ■ □ 

Definition 7.2. We say that an rj £ V 2 (T) is an optimal density-constrained flow associated with the 
solution (u,m, (3, /3t) if m(t, •) = (et)#ri ! for all t £ [0, T] and the following energy equality holds 

/ u(0 + , x)mo(x) dx = / g(x)m(T, x) dx + rn / (3t dx+ / L( 7 (f), 7 (f)) dtdrj^) 

Jr d J T d Ji d Jr Jo 

rT r 


+ 


1 0 J T d 


(/(x, m(t, x)) + (3(t, x)) m(t , x) dx dt. 
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Note that the above definition is the reformulation in terms of density-constrained flows of the 
energy equality from Definition 4.1 point (4). 

Remark 7.3. Let us observe that for an optimal density-constrained flow r], the energy equality in 
Definition 7.2 holds for any 0 < t\ < t 2 < T as well, i.e. 

/ u(tf,x)m(ti,x)dx= / u(tf ,x)m(t2,x) dx + / / 7(f)) dt dr^y) 

JT d JT d Jr Jt 1 

+ f f (f(x,m(t,x)) + /3(t,x))m(t,x)dxdt. (7-3) 

Jti J T d 

This can be easily deduced using the inequalities from Lemma 7.1 three times on the intervals [0, ti], [t 1 , t-f\ 
and [t r 2 , T] together with the global equality from Definition 7.2 and the fact that we have ( dtu) s is a 
non-negative measure (by the fact that —dtu + H(-,Du ) < a and a does not have singular part in 
(0, T) x T d ), i.e. one has always u(t~ , •)< u(t + , •) a.e. for all t € (0,T). 

Identity (7.3) implies also that (dtu) s = 0 on the support of m, more precisely 


!fd 


u(t + ,x)m(t,x) dx = / u(t ,x)m(t,x)dx, 

J T d 


(7.4) 


for all t € (0, T ). 


The following proposition gives the existence result for an optimal density-constrained flow r]. 

Proposition 7.4. There exists at least one optimal density-constrained flow rj £ V 2 (T) in the sense 
of the Definition 7.2. 


Proof. The proof uses the same construction and goes along the same lines as in [11], Nevertheless, 
we discuss the main steps here. 

We construct a family (rj £ ) £> o of density-constrained flows by 


[ T( 7 )dry £ ( 7 ) := f 'V(Xf)m 0 (x) dx, 
Jr J T d 


for any bounded and continuous map \h : T —> R, where Xf is the solution of the Cauchy problem 

w e (t,x(t)) 


X ^ m e (t,x(t)y 
x(0) = x, 


a.e in [0, T], 


( m e ,w £ ) being a standard mollification of ( m,w ) such that 0 < m £ < m. One easily checks that 
m £ (t,-) = (e t )#Ve- 

Using Lemma 4.7. from [11] we obtain that the family (r] £ ) £> o is tight. Denoting by r/ the limit 
of a suitable subsequence of such a family, this is an optimal density-constrained flow in the sense of 
Definition 7.2. The proof of this statement goes exactly as for Lemma 4.8. in [11], using the equality 
(4) from Definition 4.1 and the inequality (ii) from Lemma 7.1. □ 


7.2. Optimality conditions on the level of single agent trajectories. In this subsection our 
aim is to show that the optimal density-constrained flows are actually concentrated on paths which 
are optimal (in some weak sense) for the control problem (1.4) (see Definition 7.5). We will show that 
they satisfy a weak dynamic programming principle. 

Let us recall that fl € L^ oc ((0, T);BV (T d )) and fix € L l (Y d ). In order to handle the evaluation of fl 
along single agent paths we shall work with specific representative of it (which is defined everywhere 
in T d ). 

For an L\ oc function h ■. T (1 A 1 we define the specific representative of h by 

h(x) := lirnsup h £ (x), 
eXO 


(7.5) 
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where 

h e (x):= h(x + ey)p(y) dy 
J R d 

and p being the heat kernel 

p{y) := (2vr)- d / 2 e- |y|2/2 . (7.6) 

We use this specific regularization via the heat kernel because of the semigroup property ( h £ ) £ r = h £+£ i 
we shall profit on later. 

To treat passages to limit (in the regularization, as e f 0, similarly as in Section 6 from [3]) we will 
need some uniform point-wise bounds on f3 e , hence we shall use the properties of the Hardy-Littlewood- 
type maximal function defined with the help of the heat kernel (7.6). Thus for any h £ L 1 ( T d ) we 
set 

{Mh){x):= sup / \h(x + ey)\p(y)dy. 

£>0 J Rd 

Let us state some basic properties of the maximal functional M that we will use in our setting. First 
because of the semigroup property we have 

Mh £ = sup \h £ \ e > < sup \h\ £ = Mh. 

£'>0 £>0 

Secondly it is well-known that M leaves invariant any L p space with 1 < p < +oo and there exists 
C p > 0 such that 

\\Mh\\ Lv (jd} < C p \\h\\ LP{ j d y 

Let us recall that by Theorem 6.2 we have that M/3 £ L^ d 1 '*((0,T) x T d ) L ] l oc ((0, T) x T d ). The 
integrability property we need is only M/3 € L 1 1 oc ((0, T) x T rf ), but to guarantee this, (3 € L 1 1 oc ((0, T) x 
T d ) is not enough. 

As usual we set a(t,x) := f(x,m(t,x)) + (3(t,x) and we use its representative a (obtained as in 
(7.5)). 


Definition 7.5. Given 0 < t\ < £2 < T, we say that a path 7 £ i7 1 ([0, T]; T d ) with Ma(-, 7) £ 
LU(0,T)) is minimizing on the time interval [ii, *2] the problem (1.4) if we have 

u{t 2 ,j(t 2 ))+ f L(j(t),j(t))+a(t,j(t))dt <u(t 2 ,'y(t 2 )+u(t 2 ))+ (7.7) 

Jti 

+ [ Linif) +^(t),7(t) +u(t)) + a(t,'y(t) +u(t))dt, (7.8) 

Jtx 

for all uj £ H 1 ([ti,t 2 \',T d ) such that w(ti) = 0 and Ma(-, 7 + u) £ L 1 ([ti, £2])- 


Remark 7.6. Let us notice that for any density-constrained flow f) the integrability property Ma (-, 7 ) £ 
L‘ oc ((0, T)) is natural, since it is satisfied fj-a.e., if Ma £ L 1 1 oc ((0,T) x T d ). Indeed, we have 


r rt2 rt2 r 

/ / Ma(t, 7 (f)) dt di)( 7 ) = / / Ma(t, x)m(t, x) dx dt < + 00 , 

Jr Jti Jt! J T d 


for all 0 < t\ < t 2 < T, where m(t , •) dx = 


Theorem 7.7. For any 0 < t\ < t 2 < T, any optimal density-constrained flow rj is concentrated on 
minimizing paths on the time interval [ti, ^ 2 ] for the problem (1.4) in the sense of the Definition 7.5. 


Proof. We follow here Ambrosio-Figalli [3]. Let us take an optimal density-constrained flow 77 given 
by Proposition 7.4, fix 0 < t\ < t 2 < T and y £ T rf , take w £ iL 1 ([ti, ^ 2 ]; T rf ) with w(ti) = 0 and 
X £ C^((0, T); [0,1]) with x > 0 on (fi, t 2 ] and x(ti) = 0 a smooth cut-off function. Let us take a Borel 
subset E C r such that r](E) is positive. For e > 0 and y £ we introduce the map Tf y : T —> T by 


Te,y( 7) 


7 , if 7 i E , 

7 + w + exy, if 7 £ E. 
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Now let us define r} £ty := ( T £) y)^r ], which in particular is an admissible density-constrained flow 
satisfying the inequalities from Lemma 7.1. In addition let us remark that (et 1 )#rj £ty = (et 1 )#rj = 
m(ti, •) dx. 

Using the inequality (i) from Lemma 7.1 for r) £ ^ y (on the time interval [t\, £ 2 ]) and the equality (7.3) 
for rj (on the same interval [ii, ^ 2 ]) we obtain 


JJ 


rt2 


£(7(t)>7(t)) + a(t,7(t))d*| d»7(7) < 
rt 2 


«(*2 »7(i2)) + 

[ u(t 2 ,'y(t 2 )+u(t 2 ) + £x{h)y)+[ L(j(t)+u(t) + £x(t)y,j(t) + u(t)+£x(t)y)dt drifiy) 
J E J t\ 

+ [ [ a(t,'y(t)+u(t) + £x(t)y)dtd'n('y). 

J E J t\ 

where we are allowed to use any representative of u and a, thus we use the specially constructed ones 
u and a. Let us average this last inequality w.r.t. the variable y using the kernel p introduced in (7.6). 
We obtain 


[ [«(*2»7(*2))+ / £(7(*)>7(*)) +a(t,j(t))dt\ d»7(7) < 

J E *- Jt\ 

(*2 > 7 ( i 2 )+w(^ 2 )+£x(^) 2 /)+ [ L(j(t)+uj(t)+ex(t)y,'y(t)+u}(t)+£x(t)y)dt p(y)dydr](j) 

Ju 


+ 


t2 


E J t\ 


a £X (t)(ti'y(t) +u(t))dt drift). 


Now choosing V C H 1 ([ti,t 2 ];T d ) a dense subset with cu(ti) = 0 for all uj £ D, by the arbitrariness of 
77 for //-almost every curve 7 £ T we deduce that 


(*2>7(*2))+ [ ^(7(0>7(0) + d(t,7(t))dt 

Jti 

< [ [ L('y(t)+u(t) + £x(t)y,'j(t)+u(t) + £x{t)y)p(y)dtdy 

JR d Ju 


rt2 

+ ^x(t2)( t 2'>7fe) +w(*2)) + / «ex(t)(*>7(*) + w(i))di, 

Jtl 


for all a; € 2? and e = 1/n. By a density argument the above inequality holds for any w € H 1 ( [t 1 , t 2 \ ; T rf ) 
withcu(fi) = 0. We finally let e 4-0. As Ma(t, 7 +w) £ L 1 ([t 1 ,t 2 ]) and using the domination |a e | < Mot, 
we can pass to the limit in the last term of the above inequality. By the dominate convergence theorem 
we can also pass to the limit in the first term thanks to the growth property and the continuity of L. In 
this way we obtain the inequality (7.7) with ulfiff ,~f(t 2 )) instead of u(t 2 , 7 ^ 2 )) and uftlf , y(t 2 ) + oj(t 2 )). 
To conclude, it is sufficient to use u(tf, •) < u(t 2 , •) (a consequence of dfu > 0) and uft^, •) = u(t 2 , •) 
mt 2 - a.e. (given by (7.4)). □ 


Remark 7.8. The global version of Theorem 7.7 (to arrive up to the initial time 0 and the final time 
T) remains an open question. This is mainly due to the local integrability property for the additional 
price e Ll c ((0,T)-BV(T d )) we are aware of for the moment. Let us remark that an integrability 
property (3 £ L 1 ([0, T]; L 1+£ (T d )) for some £ > 0 would be enough to conclude in the global version. 


The notion of Nash equilibria has now a clearer formulation. Since we are able to give a weak 
meaning for the optimization problem along single agent trajectories, a solution ( u , m, /?, fix) of the 
MFG system with density constraints gives the following notion of equilibrium. 
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Definition 7.9 (Local weak Nash equilibria). Let (u,m, fl, flp) be a solution of the MFG system 
with density constraints in the sense of Definition f.l on [0,T] x T rf . We say that is a 

local weak Nash equilibrium, if there exists an optimal density-constrained flow iq G ^(r) in the sense 
of Definition 7.2 (constructed with the help of (m, (5, fir)) which is concentrated on locally minimizing 
paths for Problem (1.4) in the sense of Definition 7.5. In particular one has that mt = (et)#r) and 
0 < m t < rh a.e. in T d for all t G [0, T]. 

Remark 7.10. Let us remark that by Proposition 7.f and Theorem 7.7 for any solution (u, m, fl, flp) 
for the MFG system with density constraints obtained with the additional assumptions (HP1), (HP2) 
and (HP3) the triple (m,fl,flr) always a local weak Nash equilibrium in the sense of the above 
definition. 

7.3. The case without density constraint. Let us have a few words on the Nash equilibrium and 
on the optimality condition on the level of single agent trajectories in the case when we do not impose 
density constraints. More precisely, our aim is to clarify Remark 4.9. from [ 11 ], 

Let us recall that in Section 4.3. from [11] it was considered a class of flows rj G V r '(T d ) such 
that m G L q ([0,T] x T rf ) where rh t := (et)#rj, where r' > 1 is the growth of the Lagrangian L in 
the velocity variable, while q — 1 (where q > 1) is the growth of the continuous coupling / in the 
second variable. Because of this growth condition and since m G L q ([0,T] x T rf ) we have first that 
a(t,x) := f(x,m(t,x)) G L q '([0,T] x T rf ). Moreover Lemma 7.1 and Proposition 7.4 hold with fl = 0 
and At = 0, since we did not impose any density constraint (see the corresponding Lemma 4.6-4.8 
from [ 11 ]). 

The difference, compared to our analysis in the previous section, is that we can consider globally 
minimizing paths in Definition 7.5. More precisely, by the global integrability property of a, and hence 
Mol G L q '([0,T] x T d ) we allow curves 7 G kb 1 ,r, ([0, T]) (and their variations) such that Ma(-, 7 ) G 
L q ([0, T]). This is once again a natural class, since for any flow fj, with the above described properties, 
satisfies that 

r P2 P2 r 

/ / Ma(t, 7 (f)) dt dr)( 7 ) = / / Ma(t, x)fh(t, x) dx dt < + 00 , 

Jr Jt 1 Jt! Jf d 

for all 0 < t\ < t 2 < T, since Ma G L q '([0,T] x T rf ) and rh G L q ([0,T] x T rf ) where rht = 

By these observations in the statement of Theorem 7.7 one can change now the word “locally” to 
“globally” and the proof goes along the same lines. 
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